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Abstract. We review theoretical models of individual motility as well as collective 
dynamics and pattern formation of active particles. We focus on simple models of 
active dynamics with a particular emphasis on nonlinear and stochastic dynamics 
of such self-propelled entities in the framework of statistical mechanics. Examples 
of such active units in complex physico-chemical and biological systems are chem- 
ically powered nano-rods, localized patterns in reaction-diffusion system, motile 
cells or macroscopic animals. Based on the description of individual motion of 
point-like active particles by stochastic differential equations, we discuss different 
velocity-dependent friction functions, the impact of various types of fluctuations 
and calculate characteristic observables such as stationary velocity distributions 
or diffusion coefficients. Finally, we consider not only the free and confined in- 
dividual active dynamics but also different types of interaction between active 
particles. The resulting collective dynamical behavior of large assemblies and ag- 
gregates of active units is discussed and an overview over some recent results on 
spatiotemporal pattern formation in such systems is given. 
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1 Introduction 

In recent years there has been a strong growth of research activities regarding the statistical 
description of systems far from equilibrium. A whole class of biological and physical systems 
which may be referred to as active matter have been studied theoretically and experimentally. 
The term "active" refers here to the ability of individual units to move actively by gaining 
kinetic energy from the environment. Examples of such systems range from the dynamical be- 
havior of individual units such as Brownian motors |280| . motile cells [r23 313 41,, macroscopic 
animals |182ll95j or artificial self-propelled particles j260ll64j to large ensembles of interact- 
ing active particles and their large scale collective dynamics j354l60l2^ . A major driving force 
of the active matter research are the continuously improving experimental techniques such as 
for example automated digital tracking |321l313ll7j or the realization of active granular and 
colloidal systems (see e.g. 126011212021340150] '). 

This review is devoted to the analysis of simple dynamical models of active systems. In 
particular we will focus on stochastic models of individual active particles or agents as well 
as on large scale collective phenomena arising in systems of such interacting active particles. 
We define active motion as motion of particles or agents due to an internal driving, which 
may have different causes such as biological activity or non-equilibrium dynamics in artificial 
driven systems. It is fundamentally different from standard purely passive dynamical behavior 
of particles in gases, liquids or solid states at thermal equilibrium. In contrast, active particles 
or agents are assumed to have an internal propulsion mechanism ("motor"), which may use 
energy from an external source and transform it under non-equilibrium conditions into directed 
acceleration motion. 

The great number of publications on active particle systems makes a complete review, 
describing all the different approaches across the different scientific disciplines, impossible. Thus, 
we will focus here on the review and analysis of generic models of individual active particles 
as well as their large scale collective dynamics, which may be considered as an extension of 
concepts well known in physics, such as ordinary Brownian motion, ferromagnetic or nematic 
media. In particular, we will focus on the mathematical description and analysis of such systems 
from a (statistical) physicist's point of view. 

There are many fascinating research areas, which we will not discuss in this review, such 
as the dynamics of microswimmers at low Reynolds numbers (see e.g. j88l272l7l85l276| . or a 
recent review in |206| ). or the biological implications of collective behavior of organisms and 
animals, for example, flocks of birds or schools of fish |197l69l330ll45j . 

An important feature of most active matter systems, are the non-negligible random fiuctu- 
ations in the motion of individual active units. This apparent randomness may have different 
origins, for example, environmental factors or internal fiuctuations due to the intrinsic stochas- 
ticity of the processes driving individual motion. In animals, they may be also associated with 
abstract decision processes which govern the direction and/or the speed of individual motion 
and which may appear as random to an external observer. A simple way to account for such 
fiuctuations without being able to resolve the underlying mechanisms is to introduce stochastic 
forces into the equations of motion of individual units. Thus our general modelling approach 
will be based on the concept of stochastic differential equations (Langevin equation, SDE) and 
the corresponding Fokker-Planck equations for the evolution of the probability densities of the 
involved (stochastic) variables P^31 350.287j . 

A large part of this review evolves around the concept of "Active Brownian Particles" intro- 
duced more than a decade ago. The term was first introduced by j303j . referring to Brownian 
particles with the ability to generate a field, which in turn can influence their motion. In the 
following Ebeling, Schweitzer and others used this term in the context of self-propelled particles 
far from equilibrium (see e.g. |307I101I1 1113061292] ). In general we will refer to "Active Brown- 
ian Particles" in the latter context as Brownian particles performing active motion, which may 
be accounted for by an internal energy depot and/or a (nonlinear) velocity-dependent friction 
function. 

Throughout this review, we will focus on topics and research questions, which we have been 
actively working on over the past years. Hereby, an emphasis is put on presentation of the 
mathematical framework together with the discussion of its application to various problems. 
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1.1 Individual dynamics 

When the botanist Robert Brown observed the erratic motion of small pollen grain particles 
immersed in a liquid in 1827 [47], he considered them first as living entities. However Brown, 
being also the discoverer of the cellular nucleus, was a thorough scientist. He repeated the exper- 
iments with granular and glassy material, and discovered its purely physical nature. Although 
his name is associated with the physical phenomenon of Brownian motion, he was certainly not 
the first one to observe it. The phenomenon of irregular motion of coal dust particles immersed 
in a fluid had already been reported by Jan Ingen-Housz in 1784 |172j . 

Later on, in 1863, the origin of the never-vanishing motion was experimentally traced back 
to the motion of the molecules of the surrounding liquid by C. Wiener [363] . who was familiar 
with Maxwell's kinetic theory. Afterwards M. Gouy |140] found that the motion is amplified 
if viscosity of the liquid is lowered. After the turn of the century, A. Einstein |103I104| . M. 
Smoluchowski |357| . P. Langevin [204] . and others showed theoretically that the behavior of 
Brownian particles are due to the permanent molecular agitation of the solution on the immersed 
particle. Eventually, J. Perrin |264) was awarded the Nobel Prize in 1926 for the experimental 
observation of Brownian motion, which confirmed the theoretical findings and permitted the 
first realistic determination of Avogadro's number as indicator of the molecular structure of 
matter. 

Without doubt, the theory of Brownian motion not only assumed a central role in the 
foundation of thermodynamics and statistical physics, but is still a major interdisciplinary 
research topic. Although Brownian motion is purely physical in origin, many models of bacterial 
and small animal motion have employed the framework of Brownian motion or its discrete 
counterparts, which arc random walks. In parallel to Einstcins work, K. Pearson [2Bl 262 263] 
in 1905 invented the term "random walks" and used the concept for a statistical description of 
insects migration. 

Probably the first experiments on random motion of (living) microorganisms - which con- 
situte clearly a system far from equilibrium - infiuenced by the theory of Brownian motion 
were performed by Przimbam in the second decade of the 20th century |273I274] . Przibram 
has shown that the mean squared displacement of the protozoa in water increases linearly in 
time in analogy to Brownian motion but with a larger diffusion coefficient then predicted by 
the equilibrium kinetic theory of Brownian motion. Przimbrams work is the first experimental 
evidence of active Brownian motion. In fact, in his second paper Przimbram reported increasing 
diffusion coefficients of rotifiers with their increasing concentration, which appears to be the 
first report on hydrodynamically interacting active Brownian particles [274] . 

Przimbam's work was followed up by Fiirth |126j . who based on his own experimental 
findings, introduced the notion of persistent random walk in the description of the motion 
of biological agents. Fiirth arrived independently at the same result as Ornstein [251] who 
considered inertial Brownian motion in thermal equilibrium. 

The mathematical description of the apparently random motion of biological agents and the 
corresponding diffusion processes are fundamental to understanding the ability of individuals to 
explore their environment and to describe the large scale dispersal of populations j247j . Since the 
first pioneering works of Przimbam and Fiirth there have been a great number of publications 
on the theory of random walks and their application to biology and ecology. A prominent 
example is the work of Howard C. Berg |31j . who made random walk theory an intrinsic part of 
modeling; new concepts along these lines are developed even nowadays (2291102] . From the huge 
literature, we would like to highlight here few examples, such as the work by H. Gruler and 
M. Schienbein [300], by H. Othmer and coworkers |252ll60j or the recent integrated theoretical 
and experimental approach by H. Flyvbcrg and collaborators |314l313j . 

Because of the strong connections between the theory of Brownian motion and random walk 
theory to models of self-propelled or active Brownian particles, we will start this review with a 
summary of general findings of the classical theory and some important mathematical concepts. 

In the following sections, we will focus on the concept of self-propulsion in the framework of 
active Brownian particles. We will discuss various models of active motion not only differing in 
their deterministic equations of motion but also subject to different types of fluctuations: e.g. 
internal and external Gaussian fluctuations, (energetic) shot noise or dichotomous Markov noise. 
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We will analyze the characteristics observables of individual active motion such as speed and 
velocity probability distributions or the mean squared displacement. In addition, we will discuss 
the behavior of active particles under external constraints, such as e.g. external potentials. 

Despite the intense interdisciplinary research on active Brownian motion, there is still a lack 
of theoretical foundations. For example, one issue that has been neglected is the distinction 
between passive fluctuations (e.g. thermal fluctuations) and stochastic forces which have their 
origin in the active nature of the system and their different impact on the experimentally 
accessible observables such as stationary velocity and speed distributions. Only recently it 
was shown how internal (or active) fluctuations may lead to a complex behavior of the mean 
squared displacement of active particles with multiple crossovers or to characteristic deviations 
of stationary velocity and speed distributions in comparison to ordinary Brownian morion 
|268l29;-ij . 

1.2 Collective dynamics 

In the last two sections of this review, we will extend our scope to self-organization phenom- 
ena in systems of interacting active particles and the resulting modes of collective motion. In 
this context we introduce the term "swarms" of active particles. We use it here to refer to a 
confined systems of particles (animals in two dimensions and more general objects) performing 
collective motions under far from equilibrium conditions. The dynamics of swarms of animals is 
a traditional object of biological and ecological investigations |247] but still a rather young field 
of physical studies (see e.g. Refs. |154I353I230I306] ) . Here we will develop rather simple models 
which are based on the idea that swarm motion possesses some kind of universality |247| . The 
existence of universal features makes it possible to study swarm motion using simple models 
which are in the same universality class. Assuming that this hypothesis is true, we have the 
choice between different models of swarm motion which are in the universality class preferring 
the simplest ones. The idea which we will follow here is: Swarms may be modelled as active 
particles using the concepts of active Brownian motion |9I102) . 

Over the past decades, collective dynamics of swarms of driven particles has captured the 
growing interest of various theoretical groups. Many interesting effects of the self-organization 
of swarms have been revealed and in part already explained. We mention here the compre- 
hensive survey of Okubo and Levin (247) on swarm dynamics in biophysical and ecological 
context. Studies of Helbing |154) relate to traffic phenomena and related self-driven many- 
particle systems. Broad context of swarming dynamics in natural science is also brought up in 
the comprehensive books and reviews by T. Vicsek [3531355] . A.S. Mikhailov and V. Calenbuhr 
[230] . F. Schweitzer [306], I.D. Couzin [67], D.J.T. Sumpter [329] and Toner et. al [343] . 

A major shortcoming of the research in collective motion was the lack of empirical data 
on the structure and dynamics of real swarms. However, the situation is improving, due to 
technological advances in digital tracking and data processing, the empirical study of large 
scale collective motion in the field has become possible |17I220I5^ . Furthermore, an increas- 
ing number of controlled laboratory experiments is being performed on collective motion of 
such different organisms as fish [1], insects |50I26| . bacteria |321I322| or keratocytes (active 
tissue cells) [334] . The resulting data provide the foundation to address the question on actual 
properties of social interactions in real world swarms and flocks. 

Beyond the dynamics of cohesive swarms, we will discuss systems of active particles with a 
symmetry breaking alignment interaction, which may lead to large scale collective motion. 

The most prominent (minimal) model of collective motion of this type was introduced by 
Vicsek and collaborators in 1995 1354] . Vicsek et al. have shown how an initially disordered state 
without collective motion at large noise intensities becomes unstable if the noise is decreased 
below a critical value and how large scale collective motion emerges via a spontaneous symmetry 
breaking. 

We establish a link to publications on mesoscopic equation of motion for density and velocity 
fields of self-propelled particles |341I342I317I318I234] , where the mesoscopic equations of motion 
for the density and velocity fields were constructed using symmetry and conservation laws. 
Recently, a corresponding kinetic description was derived by a Boltzmann approach [33] . Here, 
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we derive the field equations in a systematic way from tlie microscopic Langevin equations of 
active Brownian motion witliout a restriction to constant speeds. In addition to tfie density 
and velocity fields, we consider explicitly the effective temperature field of the active Brownian 
particle gas. We consider also the important special case of self-propelled particles with constant 
speed and discuss in this context local alignment with different interaction symmetries. 

In the end of Sec. [51 we mention briefly other swarming mechanisms, such as chemotactic 
coupling or selective attraction/repulsion interactions (escape & pursuit). 

At the end we will turn our attention pattern formation of self-propelled particles with align- 
ment and discuss clustering, phase separation, and emergence of large-scale coherent structures 
in such systems. 

Finally, we will conclude this review with a summary of the contents together with a more 
detailed discussion of related expermental results as well as other modelling approaches and 
their relation to the theorctial framework presented in the paper. 
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2 Brownian motion and beyond 
2.1 Brownian motion revisited 

The behavior of ordinary Brownian particles is determined by the (passive) stochastic collisions, 
the particles suffer from the surrounding medium. There is no active transfer of energy to the 
particles. The energetic equilibrium between particles and surrounding medium, which balances 
dissipation and fluctuations, is expressed by the fluctuation-dissipation theorem. 

In the most common way (at first glance, also the simplest way), Brownian motion is de- 



scribed by Newtonian dynamics including friction and stochastic forces |204| . The motion of a 
Brownian particle subject to Stokes friction with coefficient 7 in a space-dependent potential 
U (r) can be described by the Langevin equation 

— V ; m— = -7v - VC/(r) + T{t) (1) 

with \7U = in the original publication by Langevin. He assumed temporally short correlated 
random forces J'{t), independence between coordinate r(t) and velocity v(t), and the equipar- 
tition theorem (v^) = ik^T/m where /cb is Boltzmann's constant. Ornstein and Uhlenbeck 
|348j pointed out that the stochastic force should be Gaussian distributed with independent 
components and ^-correlated time dependence 

{F{t))=Q- {F,{t)Fj{t'))=2Dp5,^,5{t~t'), i,j = x,y,z. (2) 

The components J^i(t) are referred to as Gaussian white noise with intensity Dp. Integrated over 
small time intervals dt, a stationary Wiener process is obtained. In the Newtonian equation, 
these forces yield an increment of momentum in dt with Gaussian distribution 



t+dt 



J ds J',(s) , x,y,z, (3) 



the average of which vanishes and second moment of which grows linear in dt with slope 2Dp. 
Increments at different times are independent |131l287j . 

The noise strength Dp for the momentum is connected with the noise strength for the ve- 
locities D by the simple relation Dp ~ m?D. In thermal equilibrium, according to Langevin's 
assumption, the loss of energy due to friction compensates on average the gain of energy re- 
sulting from the stochastic force. In this case, the fluctuation-dissipation theorem states: 

Dp = Dm" ^ ksTj, (4) 

where T is the absolute temperature. 

We may rewrite the Langevin equation for the velocities as follows 

■"-..^L^^i^^YEm^vwm. (5) 



dt dt m 

where the stochastic source term obeys 

m) - 0, irn^At')) = Ht-t') i,J^x,y,z. (6) 

For VC/(r) — 0, the integration of Eq. ([S]) to obtain the mean squared displacement (r^(t)) 
starting at t = at the origin gives in equilibrium using 



(r(t) ) = 6 



1 T 

t (1 - exp( — -t)) 

7 m 



(7) 
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This expression yields a ballistic growth for times smaller than i < 1/7 ^-^^ ^ linear growth for 
larger times 



{rity 



2dD^st, 



(8) 



with d is the dimension of the Brownian motion. The diffusion coefficient obeys the Einstein- 
Sutherland relation |332I103) 
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(9) 



The linear regime in t is valid at length scales exceeding the brake path / cx ^/k-QTm/^. 

In the following we will always use dimensionless units and set the mass to m = 1, resulting 
in Dp = D. Further on we use D for noise intensity of purely additive Gaussian white noise in 
the velocity coordinate. 

We are interested in the general statistical descriptions of self-moving objects. In the Marko- 
vian description, full information is provided by the transition probability P(r, v, t|ro, vq, to) 
to find the particle at location r with velocity v at time t if started at rg with vq at initial time 
tg. As well known |27I287| . the distribution function density which corresponds to the Langevin 
equation (O, is the solution of a Fokker-Planck equation of the form: 



9P(r, v,t|ro, vo,to) 
dt 



v^+V;7fr)— - — 
dr 9v (?v 



dP 



(10) 



For harmonic potentials J7(r), the solutions is a multi- modal Gaussian distribution |57j with 
time-dependent moments. In the long-time limit, the stationary solution of Eq. (jlOp becomes 
independent of the initial distribution Po(r,v) and with Eq. (U) the ensemble of Brownian 
particles obeys in equilibrium the Maxwell-Boltzmann distribution: 



Po(i", v) = JV exp 



U{v) 



(11) 



An important limiting case of Eq. ([5]) is the so-called overdamped Brownian motion. As 
pointed out by Purcell |275| and Berg [3T], this limit should be considered in the motion of 
bacteria and other small micro-swimmers due to the low Reynolds number governing their 
dynamics. Overdamped Brownian motion can be obtained from the Langevin equation under 
the assumption of large friction where inertial effects can be neglected, resulting in 



dv 

'dt 



VU{v) 

7 



(12) 



with intensity = D j^"^ . 

The corresponding Fokker-Planck equation for the overdamped dynamics reads 



5P(r,t|ro,<o) 



dt 



d_ 
dv 



VC/(r) 



P 



Dr 



gj.2 



with the stationary solution 



Po(r) = JV exp 



iDr 



(13) 



(14) 



In thermal equilibrium, this becomes equal to the Boltzmann distribution by virtue of D^ = 
^bT ll, which holds true according to the relation Eq. (|3]). 

We note that the Langevin Eq. ([5]) has been generalized in many ways. First of all, the 
description applies not only to mechanical degrees of freedom but also to voltage fluctuations 
in electric circuits ('Johnson noise') and to fluctuations in the number of molecules undergoing 
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chemical reactions ('Chemical Langcvin equation'), to name only two prominent examples. 
Finite correlations in equilibrium fluctuations and dissipation ('memory damping') have been 
taken into account in the generalized Langevin equation ^239.200 3 76 15^ . The consequences 
of nonlinear dissipation in equilibrium systems were studied as well [192j . More recently, also 
formulations of Langevin and Fokker-Planck equations that are consistent with special relativity 
have drawn much attention (for a comprehensive review on relativistic Brownian motion, see 
[89]). As for the many other generalizations and applications in nonequilibrium systems, we just 
can refer the interested reader to recent collections of articles on these topics [151114911411217] 
and the references given therein. 



2.2 Polar representation of Brownian dynamics 



Let us now consider the dynamics in two spatial dimensions and without external forces. A 
very useful representation is obtained in polar coordinates of the velocities j301j . The Cartesian 
components of the velocity Vx , Vy may be written in terms of polar coordinates as 

Vx = s{t) COS ip(t), Vy — s{t) siTiip{t) (15) 

with s{t) = \v{t)\ > being the speed of the particle and (p{t) the polar angle defining the 
direction of motion, i.e. the angle between the velocity vector and the x-axis. 
The two spatial components for the position follow the dynamics 

^r(t)=v(i)=s(i)e„(i), (16) 

were ev{t) ~ {cosip{t),smip{t)} is the unit vector in the velocity direction at time t. The 
corresponding stochastic equations for s{t) and ip{t) contain multiplicative noise 



d r— ^ , , d 1 



s = -7s + V2D^,{t), = -V2D^^{t) (17) 



and have to be interpreted in the sense of Stratonovich. The noise terms ^v{t)-, Cip{t) read 

6(0 = {£.x {t) cos LP + ^y{t) sin If) , ^^{t) = {- £_x{t) sin If + £_y{t) cos If) (18) 

and are statistically independent. However, in contrast to the angle noise S,,p{t) the mean of 
the speed noise (6(0) does not vanish. The corresponding Fokker-Planck equation for the 
transition probability in the new variables P{s, ip,t\so.ipo,tQ) reads 

a r/ ^DUU^54^^^, (19) 



dt ds \ \ / J t^^^ 5^ dip'^ ' 

which in the long time limit becomes independent of the angle and approaches the Raylcigh 
speed distribution 

2 

Po(s,^) = AA.scxp(-^). (20) 

We note here that the probability to have zero speed vanishes in agreement with the Maxwellian 
velocity distribution. The stochastic force agitating the particle permanently hinders it to come 
to full rest. This is one particular reason why the concepts of the simple Brownian motion 
framework have to be modified when applied to self-propelled objects. 
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Fig. 1. Schematic visualization of the motion of a polar particle with unit vectors of the internal 
coordinates eh{t),e^{t) at a given point in time t = to. The dashed lines indicates the trajectory of the 
particle l{t). 

2.3 Internal coordinates frame for polar particles 

Many active particles, such as for example biological agents, may have a distinct body axis 
defining their preferred direction of motion (head-tail axis) . Whereas this asymmetry is obvious 
in higher organisms, it should be noted that the crawling motion of cells is also driven by a 
polar actin cytoskeleton |236l284ll75ll99j . Also, for artificial active particles, such as chemically- 
driven colloids, it might be natural to assume a preferred direction of motion based on their 
propulsion mechanism |260ll64l295j . 

Without resolving the details of the origin of the asymmetry we simply assume that the 
polarity of particles introduces a distinct orientation, which we will refer to as heading. In 
general, we define the heading by a time dependent unit vector e/i, which in two dimensions is 
entirely determined by a single angular variable (/): 



Thus the velocity of a point-like polar particle can be expressed by its velocity with respect to 
the heading and the corresponding heading vector v = veh. The velocity v can be positive or 
negative, which can be identified with "forward" and "backwards" motion with respect to the 
heading. In order to be able to span the two dimensional space we need a second unit vector, 
which can be associated with the angular direction perpendicular to the heading direction 



Here, we should emphasize that, despite the apparent similarities, the {v, 0)-coordinates have 
to be distinguished from polar coordinates {s,(p). In polar coordinates the speed is always 
positive s{t) = |v| and the velocity unit vector e„ is defined by the direction of the velocity 
vector at time t. In (v, (/))-coordinates the velocity w of a polar particle can be also negative, 
corresponding to backwards motion of the particle with respect to its heading. Furthermore, 
the heading vector does not depend on the momentary velocity but is defined by the intrinsic 
polarity of the particle. In Fig. [T] a schematic visualization of a moving polar particle and the 
corresponding unit vectors is given. 

In general the following relations hold between the two coordinate systems: 



eh{t) = {cos (j){t), sin (f>{t)). 



(21) 



^<t>{t) = {- sin (j){t), cos (l){t)). 



(22) 




for V > 
for V < 




for ?j > 
for 7J < 



(23) 



In cases, where the velocity v is restricted to positive values, or where the particle is apolar, in 
the sense that its velocity dynamics are indistinguishable for forward and backwards motion, 
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the internal coordinate frame cannot be distinguished from the polar coordinates. In this cases 
we will use throughout the review the corresponding polar coordinate unit vectors (e/, — > e^,, 
e^). 



2.4 Markovian dichotomous process and white shot noise 

In this review, we will often make use of the dichotomous Markovian process (DMP), also 
called, the random telegraph noise. For this reason, we give here more details on this process 
and its white- noise limit case, called white shot noise or Schottky-noise j45ll31j . 

Because we are concerned with random motion, we illustrate the DMP by the example 
of dispersing particles immersed in a flow through a cylindrical tube with layers of different 
velocities. We follow here the work by van den Broeck j78j who revisited Taylor dispersion in 
1990. The problem was first considered experimentally and theoretically by G.I. Taylor in 1921 
|339j and in a series of papers in 1953/54 |336I 338'337I. Similar theoretical problems have been 
formulated also by S. Goldstein and others pL37 180 252]; comprehensive reviews about DMP 
in dynamical systems can be found in |16I162I2^ . 

Taylor found that particles subject to layers of different flow velocities undergo additionally 
to the main stream flow a diffusion-like motion. To obtain this behavior, he considered scattering 
of the particles in the stream causing random jumps of the particle to other velocity layers. He 
even linked this behavior and his analysis to Pearson's problem of random insect migration. 

Let us consider a flow in one dimension with two layers and with x{t) denoting the position 
of the suspended particle in the frame co-moving with the mean flow. It is assumed that the 
particle changes randomly with a given constant rate A between the two layers in which it moves 
with a constant relative velocity, either +vo or —vq. The velocity is then a DMP ^z)j\/p(t), and 
the Langevin equation for the particle reads 

^^x{t) = (dm pit). (24) 

For a temporally symmetric DMP, the life time of one of the velocities (before switching to 
the respective other one) is governed by an exponential distribution 

w{t) dr = Acxp(— AT)dT. (25) 

The transition probability densities P±{x,t\xo,£,o,to,) for the particle to be at r and the 
DMP to be at £^{t) = zLvq at time t given the particle was at tq and the DMP was at at time 
to is governed by equations like 

dP dP 

^^-.o^-AP, + AP., (26) 
dP dP 

_.+„„_ + AP,-AP_, (27) 

The conditions for to enter by the initial conditions for P± at t = to- The probability averaged 
over the two velocity states and their initial states P{x, t) = P+ (x, t) + P_ (a;, t) is given by the 
known second-order telegraph equation ^315 162 16l45l29j 

This equation can be solved in terms of modified Bessel functions but has been supplemented 
by initial conditions for P±^g or, respectively, P and the flux J = vo{P^ ~ P-) in '^o and at to. 
Multiplication by x'^ and integrating over x yields the same equation which Langevin earlier 



obtained for Brownian motion (204j with the respective re- assignments. By starting exactly at 
xo = at time to = 0, one finds that the mean square displacement evolves according to 



t - ^ (1 - exp(-2At)) 



(29) 
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which should be compared to Ec^. [T] 2A corresponds to the relaxation rate (7 in Eq. [7]) and 
Wo/(2A) is the spatial diffusion coefBcient {ksT/j in Eq. [71); an additional factor of three in 
Eq. [7]is due to the difference in spatial dimensions. 

A generalization to an asymmetric two state process with different rates X± and different 
values of the velocity S,DMpit) = v± can be easily formulated. The transition probability is 
expressed by the equation 

Here the mean velocity (w) = + X+v^)/{X+ + A^) was used. The diffusion coefficient 

in the asymmetric case can be calculated as 

- (A+ + A„)3 ■ (31) 

We now outline the DMP's limit case of white shot noise US]. The asymmetric DMP, as 
discussed so far, acts like a colored noise. Its inverse correlation time is given by the sum of the 
switching rates = A_ + A+. The noise strength is determined by Dump = {v+ — f-)^Tc/4. 
The limit to white noise can be taken if shifting one of the possible velocity values to infinity 
combined with a simultaneous vanishing of its live time. Specifically, we let the upper level 
t;+ — > 00 and its live time r+ = 1/A-i- — > while keeping the mean area r+ = constant. In 
this way, the DMP S,DMp{t) collapses to shot noise ^sN{t)- It consists of a sequence of 6 peaks 
with weights hf. 

n(t) 
i 

The number of events n{t) in the interval (0, t) follows from a Poisson distribution |224I254I52I71I106I190I377] . 

PMt)) = Prob\n(t) = n] = -^^^^ exp(-At). (33) 

71! 

Here A is the rate of generating spikes, which equals the inverse living time of the lower state 
V- of the DMP, i.e. A = A_ = l/r_ . 

The weights hi are exponentially distributed, which is a property inherited from the statistics 
of the stochastic duration of the DMP's upper state [45] - the latter remains exponentially 
distributed even in the limit case of a vanishing mean live time. Its mean value approaches the 
fixed area in the limit (hi) = h = limT-^^o i'+t+. 

How similar is shot noise to the more commonly used Gaussian white noise? Like the latter, 
shot noise is a white noise, i.e. these fluctuations are 6 correlated. This can be also seen by 
means of the correlation time Tc = (A+ + A_)~^, which vanishes if one of the live times (A^^ or 
XZ^) goes to zero. Remarkably, is dominated by the smaller of the two mean live times (i.e. 
by the higher rate). 

While temporal correlations of shot noise and Gaussian white noise are similar, the distri- 
bution of shot noise is obviously not that of a mean-zero Gaussian distribution. First of all, 
shot noise has a mean value {£,sN{t)} ~ v- + h/ t- which is in general different from zero. 
Secondly, there is a strong asymmetry between the positive spikes and the negative base line 
V- , which stands in marked contrast to the reflexion symmetry of any Gaussian distribution. 
This asymmetry affects also severely the statistics of dynamical systems driven by shot noise 
(see, for instance, studies by Richardson and Gerstner [2821283] ). 

The difference from a Gaussian process can be quantified by the parameter [45j 

G^\v+-v.\t,. (34) 

This value will vanish if simultaneously both lower and upper levels diverge according to v± — > 
±00 and the respective mean live times vanish A^^ — ^ while the two mean areas w+t-|_ and 



16 



Will be inserted by the editor 



t;_T_. arc kept constant and equal to each other. Obviously, this limit restores the symmetry 
of the process. Furthermore, it can be shown that third- and higher-order cumulants of the 
increments of this symmetric shot noise become negligible and that its effect on any dynamical 
system is completely equal to that of Gaussian white noise. In this sense, the DMP approaches 
Gaussian white noise in the above limit, although it still attains only two discrete values in this 
limit. 
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3 Basic concepts of self-propulsion 
3.1 Dynamics of active Brownian particles 

3.1.1 Nonequilibrium, nonlinear friction and external forcing 

So far energy was supplied to the particle by molecular agitation which has led to stochastic 
forces. In this Section, we want to generalize the idea of Brownian particles by including an 
additional energy input. In this way we will be able to derive a simplified model of biological 
motion which we call Active Brownian motion. 

The major question wc will address now is how this known picture changes if we add an 
internal "activity" of particles. Our main assumption is the additional inflow of energy leading 
to active motion can be described effectively by negative dissipation in the direction of motion. 
Hence, it will be modeled by negative friction instead of a constant friction coefficient 7. We 
introduce a nonlinear friction 7(r, v) which is a function of the position and velocity and, what 
is most important, has regions in the phase space (r, v), where it assumes negative values. 
In addition, fluctuation-dissipation relation becomes invalid for the non-equilibrium case of 
self-propulsion |176j . 

Simple models of such active Brownian particles were studied already in several earlier works 
(see e.g. |300l324ll91l303l286l230l306j ) . Here we will review and analyze in a more systematic 
way models of active Brownian particles with negative friction as well as the depot model 
of particles which are able to store the inflow of energy in an internal depot and to convert 
internal energy to perform different activities |307ll01j . Other versions of active Brownian 
particle models |303l286l consider more specific activities, such as environmental changes and 
signal-response behavior. In these models, the active Brownian particles (or active walkers, 
within a discrete approximation) are able to generate a self-consistent field, which in turn 
influences their further movement and physical or chemical behavior. This non-linear feedback 
between the particles and the held generated by themselves results in an interactive structure 
formation process on the macroscopic level. Hence, these models have been used to simulate 
a broad variety of pattern formations in complex systems, ranging from physical to biological 
and social systems PTO 3 03 309 156 230 30^. 

Most of the time we will consider problems homogeneous in space with 7(r, v) = 7(v). 
The situation of spatially localized energy sources (food centers) generates more complicated 
dynamics and was discussed in |101| . For such energetic pumps, the basic ideas about nonlinear 
friction have been formulated by Helmholtz and Rayleigh, whose aim was to model the complex 
energy input in musical instruments. These models applied to walkers will be the starting 
point, followed by a model of particles with an internal energy depot. It will be assumed that 
the Brownian particles have the ability to take up energy from the environment, to store it 
in an internal depot and to convert internal energy into kinetic energy. Further on, we will 
discuss some specific models of active Brownian particles with a particular focus on the role 
of active fluctuations. We will conclude this section with a brief discussion of a generalized 
model of active particles, where the direction of propulsion (motor direction) is considered as 
an additional degree of freedom. 

In other words we use Langevin equations which include acceleration terms resulting from 
the energy inflow. We will show, that in comparison with simple Brownian particles, the dy- 
namics of active particles becomes much more complex, which result in new dynamical features 
as e.g.: 

— new diffusive properties with large mean squared displacements, 

— unusual velocity distributions with crater like shape, 

— formation of limit cycles under conflnemcnt corresponding to motion on circles in space. 

Some of these features may resemble active biological motion. Hence, the basic idea can be 
formulated as follows: how much physics is needed to achieve a degree of complexity which 
gives us the impression of motion phenomena found in biological systems? 

In order to avoid misunderstandings we would like to stress again, that we do not intend 
here to model any particular biological or social object but instead to analyze general physical 
systems far from equilibrium, which exhibit active motion and new types of dynamics. 
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3.1.2 Active Brownian particles: velocity-dependent friction 

The motion of Brownian particles with general velocity- and space-dependent friction in a 
space-dependent potential U{r) can be described again by the Langevin equation (sec Eq. ([l}: 

f = V ; ^ = F,,,, - VC/(r) + ^(t) (35) 

The new feature is the dissipative force which is now given with a position and velocity depen- 
dent coefficient 

Fmss = -lir,v)^r . (36) 

The force acts in direction of the motion and the friction 7(r, v) may depend on space, velocity 
and time. The term J^(i) is a stochastic force with strength D and a (5-correlated time depen- 
dence, see Eq. But now, due to nonequilibrium, this noise strength is independent of the 
parameters in the dissipative force and the Einstein relation is considered invalid. 

We consider, without loss of generality, m = 1 and Dp becomes D, which gives us the 
following Langevin equation with unsealed Gaussian white noise ^(i) as defined in Eq. 

§ = v; ^ = -7(r,v) - VC/(r) + V2Dm (37) 

It gives the basis for the derivation of an energetic balance. From the time derivative of the full 
mechanical energy one obtains 

d dv , ^dr , ^ 

—E = V — + VUiv)— (38) 
dt dt ^ ^ dt ^ ' 

which averaged over the noise yields 

= -7(v,r)v2+i? (39) 

One sees that negative values of the friction coefficient lead to an increase of the mechanical 
energy. 

Since the fluctuating source is Gaussian white noise the transition distribution density 
P(r, V, t|ro, vq, to) obeys a Fokker-Planck equation 

aP(r,v,^|ro,Vo,to) , dP dP di ^ p ^ n ^^1 (a<^\ 

In the important case that the friction coefficient is only velocity dependent and external forces 
are absent (VJ7 (r) = 0) the velocity distribution becomes stationary and it holds 

V 

Po(v) = AAexp{-l y'dv'7(v')v'}=AAexp{-^}, (41) 

where ^(v) is the effective velocity potential. Let us consider now several models of the self- 
propelling mechanism. Velocity-dependent friction plays an important role e.g. in certain models 
of the theory of sound developed by Rayleigh and Hclmholtz. Following them we assume a 
parabolic behavior of the friction coefficient 

7(r,«) = -a + /3v2 = a (^^ - 1^ = P {v^ - vl) (42) 

This Rayleigh-Helmholtz- model is a standard model studied in earlier papers on Brownian 
dynamics |191I116) . We note that Vq = a//3 defines a special value of the velocities where the 
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friction is zero. At low velocities (u^ < Wq) the friction is negative. Hence, the particle gains 
kinetic energy from the pump. Alternatively motion with greater velocities will be damped. 

Without noise the direction of motion is defined by the initial condition. With noise the 
particle moves in the long time limit in all directions. This is seen from the shape of the 
stationary velocity distribution 

Po(v) = AAexp{l(a^ - (43) 

Dependent on the sign of a, the particle is passive (a < 0) or active (a > 0) extracting or 
pumping energy, out of or into the kinetic energy of the particle, respectively. The corresponding 
single peaked and crater-like distributions are presented in Fig. [2j 

The second standard model for active friction with a stationary velocity vq was derived from 
experiments with moving cells and analyzed by Schienbein and Gruler in 1993 |300I116] . 

It was originally formulated for the speed as a variable and may be seen as a linear simplifi- 
cation of the Rayleigh-Helmholtz friction. The dissipative friction force can be written in terms 
of speed s = |v| and the corresponding unit vector e„ = v/s as 

-7(v)v = -70 (s - i;o)ei,. (44) 

It was shown by the mentioned authors that this model allows to describe the active motion 
of several cell types as e.g. granulocytes. A disadvantage of this model is the discontinuity of 
the friction term at v = 0. An advantage is the convergence of the friction for large speeds s 
to linear (Stokes) friction. The stationary velocity distribution for the friction function in Eq. 
(|44)) in Cartesian coordinates reads |116j 

Po(v)=AAexp{-^(|v|-t,o)'} (45) 

An alternative formulation of the Schienbein- Gruler friction takes into account the polarity 
of an active particle (see Sec. 12. 3p . which may be motivated by the distinct body axis of many 
organisms, defining their preferred direction of motion (head-tail axis). Also, for artificial active 
particles it is often natural to assume a preferred direction of motion based on their propulsion 
mechanism. The preferred direction of motion (heading) is given by the unit vector {\eh\ = 1) 
and the Schienbein-Gruler friction can be written as (see Sec. 12. 3p : 

-7(v)v = -70 {v - vo) Bh. (46) 

Please note that the two different Schienbein-Gruler variants are only equivalent if we define 
the heading vector as the velocity unit vector e/j = e„ = v/|v|. In the general case, the second 
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(polar) variant of the Schienbein-Grulcr friction (j46|) is not symmetric with respect to v — 0. It 
accounts also for the possibility of backwards motion with respect the heading direction, which 
Schienbein and Gruler neglected in their original work |300] . As a consequence the first variant 
of the friction function is symmetric with respect to u = (apolar): there is no front or back 
for an active particle - the particle moves always to the "front" . Related equations of motion 
with constant propulsion and linear friction have been used for example in the description of 
bacterial motion |72l65j . 

In the following we will use, if not otherwise stated, the polar variant of the Schienbein- 
Gruler friction 

With velocities in polar representation (see Sec. 13. 2|) the stationary distribution can be 
derived. It will be reached at times large compared with 1 /70 and is independent on the direction 
of motion and reads for the polar Schienbein-Gruler friction: 




Again a crater-like distribution is established if uq > |293) . 



3.1.3 Depot model 

Now we will consider a friction function which is well behaved in the full velocity range. This 
friction function is based on the idea of particles with an energy depot j307ll01l306| . and has 
been recently used in the context of bacterial motion j66ll29j . We assume that the Brownian 
particle itself should be capable of taking up external energy storing some of this additional 
energy into an internal energy depot, e{t). This energy depot as an internal property of the 
considered objects may be altered by three different processes: 

1. take-up of energy from the environment; where q{r) is a space-dependent pump rate of 
energy 

2. internal dissipation, which is assumed to be proportional to the internal energy. Here, the 
rate of energy loss, c, is assumed to be constant. 

3. conversion of internal energy into motion, where /i(v) is the rate of conversion of internal 
to kinetic degrees of freedom. This means that the depot energy may be used to accelerate 
motion on the plane. 

The extension of the model is motivated by investigations of active biological motion, which 
relies on the supply of energy, which is dissipated by metabolic processes, but can be also 
converted into kinetic energy. The resulting balance equation for the internal energy depot, e, 
of a pumped Brownian particle is then given by: 

|e(t) = g(r)-ce(t)-Mv)e(i) (48) 

A simple ansatz for q{r) and (i(v) reads: 

qir) = qo h{w) =. (49) 

where d > is the conversion rate of internal into kinetic energy. Under the condition of 
stationary depots we get 

The energy conversion may result in an additional acceleration of the Brownian particle in the 
direction of movement. This way we get for the dissipative force including the usual passive 
friction and the acceleration on the cost of the depot 

Fdtss = -70V + de{t)v (51) 
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v/vq 

Fig. 3. Friction force driving active particles corresponding to the depot model (SET-model) : (i) 
Passive friction force q = Q,C, = —1 (dash-dotted straight line crossing the center), (ii) Depot model for 
positive values of the strength of driving: ^ = 0.5 (dashed line); C = 2 full line; C, = oo (dash-dotted 
line with a step at zero). 



Correspondingly, wc find a Langcvin equation which contains an additional driving force, 
de(t)v: 



dt 



V 7ov -I- V[/(r) = de{t)w + T{t) 



(52) 



Hence, the Langcvin Eq. (|52p is now coupled with the equation for the energy depot, Eq. 

The energy loss of the depot is fully converted into kinetic energy of motion of the Brownian 
particle. This is confirnied by the balance of the kinetic energy: 



VxVx + VyVy = {de - 7o)v^ + sfTo v • | 



(53) 



where the first term on the r.h.s., the input of kinetic energy, is equal to the negative of the 
last term in Eq. 

In most cases wc will assume in the following that the energy depot is stationary e(t) = 0. 
This allows the adiabatic elimination of the energy and leads to an effective dissipative force 
(see Fig. El): 



Fdiss(v) = 
The corresponding friction function is 

7(v) 



70 



dq 



d-w"^ 



70 



dq 



dv2 " 



(54) 



(55) 



The behavior of the force and the friction changes qualitatively in dependence on the bifurcation 
parameter |116| 



dq_ 

c7o 



1. 



(56) 



For positive C"values we observe that the force disappears for three values of the velocity, 
corresponding to an unstable velocity fixed point for vanishing velocity w = and two stable 
fixed points at a finite speed = v'^> 0. 

Let us now consider several special cases in more detail: In the case that the velocities are 
small (v^ ^ c/d) we get for the friction law 



7(vj 



70 



dq 
c 



(57) 
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Fig. 4. Stationary Cartesian velocity distribution function of active Brownian particles for the depot 
model with under-critical values of the parameters (left panel; passive regime, qo — 0.5) and with 
over-critical parameter values (right panel; active regime, qo — 2.0). Other parameter values: d = c — 
70 = 1.0, D = 0.5 



which corresponds with 



dq 

70 



70 ; 



qd 
72 



(58) 



to the Rayleigh-Helmholtz model discussed above (02]). 

The dissipative force for different values of C is shown in Fig. |3l For positive C: due to 
the pumping with free energy, slow particles are accelerated and fast particles are damped. At 
certain conditions our active friction functions have a zero corresponding to stationary velocities 
vq, where the friction function and the friction force disappear. The deterministic trajectory of 
our system moving on a plane is in both cases attracted by a cylinder in the 4d-space given by 



Z I Z Z 
V. +Vo= Vr. 



(59) 



where vq is the value of the stationary velocity. For the Rayleigh-Helmholtz model (RH) and 
the depot model (DM) the stationary velocities read: 



? (RH); 



^ -3 (DM). 

70 a 



(60) 



We insert the effective force of the depot-model ([54]) into the Fokker-Planck equation. The 
stationary solution of the latter reads approximately 



Po(v)=AA(l + ^v2^ '° 



cxp 



70 2 
V 

2D 



(61) 



The figure S] shows a cross section of the probability distribution for Rayleigh-Helmholtz and 
Schienbein-Gruler-Helbing friction function. In case of strong noise and low pumping the parti- 
cles approach high velocities and broad distributions. Except in the close vicinity of vanishing 
velocities the pre-factor in equation (1611) can be neglected. 



3.1.4 The limiting case of constant speed 

The velocity distributions, Eqs. (|43| . (|45|) . (|47)) and (|6T|) . collapse to a J-peaked distribution at 
Vq in the limit of vanishing noise with respect to the pumping term. The limit has to be taken 
such that 13 /D or 70/-D — ^ oo, respectively, and with vq = const. ^ one gets 



Po(|v|) cx S{\v\~vo) 



(62) 
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It yields the case of constant speed in which the dynamics of the particles can be described by 
the angular direction if(t) and spatial coordinates. The dynamics is given by Eq. (|16|) and the 
corresponding Langevin equation for the angle, i.e. the velocity dynamics Eq. p7)) reduces to 



s(t) = uo = const. , 



d 1 

at vq 



(63) 



A more detailed discussion of specific aspects of these models will be given throughout the next 
two sections. Here we point out that the important class of models with constant speed emerge 
from the Active Brownian particles framework in the discussed limit. Thus, we emphasize, that 
the concept of Active Brownian particles goes beyond this restriction and accounts naturally 
for fluctuations of the speed. 

Assuming constant speed s{t) = vq = const, {vq > 0) the Fokker-Planck-Eq. (IT^ describes 
transitions in the angle dynamics by P{ip,t\ipQ,to) and reduces to 



dPiip,t\^o,to) _ Dd^p 



dt 



Vq d(p^ 



(64) 



With the initial condition P(iy9, to| VOi ^o) = ~ Vo)^ this equation is solved by a Gaussian 
with phase diffusion coefficients 



= D/vl . 



(65) 



Taking into account the periodicity of the heading P{^TT,t) = P(7r,t), the time dependent 
solution of ([M)) reads 



P{Lp,t\ipo,to] 



1 (l °° 

V"" n=l 



</Jo) exp ( - n^{t - io) 



(66) 



For large times {t~to — > oo), the distribution P{ip, t\ipQ, to) converges towards the homogeneous 
distribution l/(27r), which corresponds to a complete loss of information of the initial direction. 
The relaxation rate of the angular function in Eq. (|64|) is given by the relaxation rate of the 
first Fourier mode {n = 1), i.e. = Vq/D. 

It might be of interest to inspect the full dynamics of Eq. in Cartesian velocity compo- 
nents. The Fokker-Planck equation for the probability distribution of positions and velocities 
assumes the form 



9P(r,v,f|ro,vo,to) ^ _^ dP 
dt ^ dx 



V. 



dP 
^ dy 



D 
7^ 



d 

dvx 



_d_ 

dv,, 



1 2 



(67) 



where we have use the Stratonovich interpretation. This equation is the starting point for the 
derivation of equations for the moments of the probability distribution. Later, we will use them 
to formulate hydrodynamic equations for the density, velocity, and temperature of an ensemble 
of active particles. Here, it is instructive to look at the dynamics of the mean velocity u(t). To 
obtain the dynamics for u, Eq. (j67[) is multiplied by v and integrated over possible velocity 
values. This expression is normalized by the local density. Further, for simplicity we assume a 
homogeneous situations and put all spatial derivatives to zero. This yields 



dt 



u{t) 



D 



(68) 



The mean velocity relaxes to zero and the mean relaxation time = Vq/D is inverse to the 
intensity D of the noise which acts on the angle leading to a loss of directed motion. 
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3.1.5 Angular dynamics of Active Brownian particles 

Some of recent measurements [250] indicate that during short time intervals the hops leading 
to the overall random motion of Daphnia may follow with some preferred angle to the left or 
right with respect to their previous direction of motion. In the following we will consider generic 
models which describes such kind of motion. We will present some details within a model of 
active Brownian motion and formulate also random walk model for a hopping dynamics. 

The aim is to develop powerful techniques for the determination of the diffusion coefficient. 
This diffusion coefficient if of central interest |247j in certain problems e.g. in ecology and has 
received renewed attention recently [23111951302121412151268] . It was proposed to be the central 
interest since an optimally selected diffusion coefficient might give an advantage in the search 
for food |128I75I76] . Food consumption in a fixed time and in bounded geometries depend 
significantly on the value of the spatial diffusion and can be maximized by optimal selection of 
its value j302j . 

Here we look first at active Brownian particles performing the motion with a preferred 
rotation direction, quantified by the angular velocity f2. Motivated by the example of Daphnia 
mostly performing an in-plane motion, we confine ourselves to a two-dimensional situation. In 
what follows, we first consider the properties of the angular motion of such active particles. In 
the next chapter, we will discuss how they affect their spatial diffusion. Here, we concentrate 
on the quite realistic case when the speed (absolute value of the velocity) can be taken as a 
constant but fluctuations in the direction of motion cannot be neglected. 

The inclusion of turning angles is best represented in a polar coordinates description. Simply 
requiring that the angle will change per unit time by a fixed amount is described as 

^ ^{t) = Q{t)g{s) + , (69) 

dt s 

where Q{t) is the instantaneous angular velocity. The function g{s) shall describe a principal 
variation of the angular velocity in dependence on the speed s = |v|. It is obvious that this 
function can be also a function of (p if the problem is not isotropic, say in case of applied 
external forces. 

The second term on the r.h.s. of Eq. (|69|) stands for the fluctuating force with intensity 
D. An important case is that Q is constant or switches between two different constant values, 
which represent two possible turning behaviors of the particle (dichotomous switching). As a 
transition rule for the switching between the two turning velocities one might assume that the 
dynamics follows a dichotomous Markov process, or as shown in the next section, the problem 
can be formulated as a renewal process with arbitrary waiting times densities in both states. 
Last but not least, fl can be also a second Gaussian random process, which we will introduce 
later on as active internal noise. It has a component perpendicular to the direction of motion 
with g{s) = 1/s (see Eg. I86|) and stands for a random variation of the angular velocity. 

In case of active Brownian particles we formulate the problem as a Newtonian dynamics 
with specific forces. The arising question what forces correspond to the introduced angular 
velocity can be easily answered via a transformation back to Cartesian velocities. In the two 
dimensional case we find in addition to the active pump and the noise term a force with 

^v(OcxF,™, =5(|v|)(J{;H). (70) 

It resembles a Lorentz or Coriolis force with a vector = (0, 0, Q) pointing in the z-direction 
perpendicular to the plane of motion. For the Lorentz-force, if the vector is the magnetic 
field and .g(|v|) = 1, a charged particle performs a Larmor precision motion on a circle with 
radius depending on the initial conditions. Choosing 5(|v|) = l/|v| the turning force becomes 
independent on the speed, which has been verified in experiments on artificial active particles 
[260j . We point out that the consideration of white noise (shot or Gaussian) will lead to a 
Stratonovich term, which will be discussed later on. 
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We proceed with the assumption that the velocity approaches quickly a stationary speed 
(s -> Wo, Eq. [62)1 . From (|69)) one obtains the Fokker-Planck-equation (for the case that the 
angular velocity is not a white noise) 

d dP d'^P 

-P(,,t) = -^(t)-+D,— (71) 

with D^p defined in Eq. We note that D^p is not necessarily small: For the Rayleigh- 

Helmholtz model (|42p with S> D the value of vq is of the order \Ja/ (3 and ~ 0(3/ a 

can be rather large for moderate values of a. 

For a constant value of the angular velocity Q this motion can be described by the following 
unwrapped transition probability density (t > 0) : 



3.1.6 Active Brownian dynamics resulting from coupling of molecular motors 

An example for active Brownian motion arising as a collective effect is the intracellular transport 
by coupled molecular motors. Motor proteins like myosin or kinesin run along filaments (actin, 
microtubules) within the cell, transport vesicles, or provide active forces |176ll63j . Single motors 
have a preferred direction of motion along a given filament, a motion that is powered by ATPase. 
In many situations motors are coupled, for instance, when pulling collectively at a large vesicle 
|144j . Collective effects in motor assemblies can be studied in vitro in motility assays in which 
the roles of transporter and track are reversed: on a glass surface covered with motors fixed 
in their position, a filament is transported involving typically a large number of motors (up 
to a few hundreds). A genuine collective effect which has been found in such experiments, is 
the occurrence of bidirectional motion. A filament running for a while in one direction suffers 
apparently spontaneously a reversal of the direction of motion and runs "backwards" [109] . This 
and other features of coupled molecular motors have been studied in the model by Jiilicher and 
Prost, that we briefiy discuss and for which we review the relation to an active Brownian 
particle's dynamics in the following. 

The interaction between motor proteins and filament can be captured by different free 
energy landscapes between which the system switches by binding and release of ATP/ADP. 
Essential features of the motor's dynamics can be already captured in a model system switching 
between only two potentials where one of them is flat while the other one possesses a periodic 
structure with broken spatial symmetry (ratchet potential). Typically, the unbinding of the 
motor depends on its position along the backbone while the binding of ATP can be assumed to 
be independent of the motor position. The motion of the motor is affected by two kinds of noise: 
the thermal motion and the switching between the two states which is likewise stochastic. In a 
simple approach to the dynamics of motor assemblies, the coupling of motors can be regarded 
as rigid leading to only one spatial degree of freedom: the position of the backbone (e.g. its 
center of mass). In this approximation, the force acting on each motor contributes to the total 
force on the filamentous backbone and, in turn, the velocity of the single motor is given by that 
of the backbone. The equations for the overdamped dynamics of the backbone read 

1 ^ Ik T\ 

M = F,., --Y^a^(t)W'{x + j ■ q) + V^^(t), 

a, =0 a,=l. (73) 

ri{x+3-q) 

Here, x is the central coordinate of the backbone, A is a an effective friction coefficient per 
motor, Ff.xt an external force applied to the backbone, and W{x) is the piecewise linear ratchet 
potential shown in Fig. [5^, the asymmetry of which determined by the parameter a (see Fig.[S^; 
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Fig. 5. Model of coupled molecular motors (CMM) (a), a typical trajectory of the backbone (b), and 
the corresponding velocity (c) for TV = 300 and a — L/2. For large A'', the dynamics of the CMM model 
can be approximated by the dynamics of an active Brownian particle. Panel (a) modified from |218] . 



for a = L/2 the potential is symmetric). The state of a given motor j at time t is determined by 
the variable ^^{t) which takes the values or 1. The switching rate tq for the transition 1 
docs not depend on the spatial position. The rate for the transition 1 — )■ attains the value fi 
only if the motor is within the neighborhood of size d centered around the potential minimum 
and is zero otherwise. Parameters in the following arc L ~ 1, d ~ Q.2L, W — 1, X = 0.01, 
rp =40, and fi = 500. For simplicity, thermal fluctuations are neglected. 

Simulations of the model for a large number of motors reveal a bidirectional motion of 
the assembly (cf. Fig. [SJd) corresponding to a bistable velocity dynamics (Fig. [St). It has been 
suggested |14I218I344) that the velocity of a large motor assembly {N ^ 1) can be well described 

by 

i^v, v^f{v)+g{vm), (74) 

i.e. by an active Brownian particle (ABP) model, in which we also allow for a speed-dependent 
noise intensity. This means essentially that for large N (i) the space dependence of the problem 
vanishes and (ii) the many dichotomous degrees of freedom together with the interaction of 
motors and potential results in one continuous degree of freedom (the velocity). The original 
problem does not possess any inertia, the new time scale introduced in Eq. (j74p comes from 
the switching times of the motor and the relaxation of the probability density of motors in the 
spatial ratchet potential. 

We can write down a rather lengthy Master equation with one spatial degree and N di- 
chotomous degrees of freedom for the system Eq. (|73p and try to approximate this equation by 
a Fokkcr-Planck equation with one spatial and one velocity degree of freedom corresponding to 
Eq. ([7^ . Whether this is possible and if so how this mapping can be carried out analytically 
is still an open problem. In the following, we present some numerical evidence that a mapping 
from CMM to ABP model is a meaningful approximation. 

Assume, that Eq. ([71)1 is a reasonable approximation of the CMM model and suppose, a long 
time scries of the assembly's velocity is given, how could we determine the functions f{v) and 
g{v)? There are two methods to determine these functions j370l344j . First, we could measure 
how the velocity changes on a short time-scale. Mean and variance of the instantaneous velocity 
changes should be proportional to f{v) and g{v), respectively. Put differently, one measures 
the Kramers-Moyal coefficients of v{t) [287] . Secondly, we could also measure the stationary 
distribution P(v) (long-time statistics), which is uniquely determined by the two functions we 
are seeking. Together with one additional piece of information involving the time scale of the 
system (e.g. the rate of velocity reversals or the spatial diffusion coefficient), one can determine 
both functions f{v) and g{v). 

The two methods have been applied to the CMM model in Ref. |344j , and the resulting drift 
and diffusion functions in the symmetric case are shown in Fig. [S) The agreement between the 
functions determined by the independent increment and distribution methods is remarkable 
and thus shows that the ABP model is a reasonable approximation of the CMM model. The 
function f{v) displays the shape of an inverted N, in particular, it possesses a negative slope 
for V = 0, i.e. a vanishing velocity is dynamically unstable. The noise in the approximate ABP 
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Fig. 6. Drift (a) and noise amplitude (b) of the CMM model estimated by the increment (solid) and 
distribution (dashed lines) methods for the symmetric system with a = L/2. In (c) the velocity power 
spectrum of the CMM model (dashed line) is compared to that of the approximating ABP model; for 
the latter, f{v) and g{v) were estimated via the distribution method. Also shown in (c) is the analytical 
approximation Eq. (|75|l (solid line) to the ABP's power spectrum consisting of two Lorentzian spectra. 
Modified from 



dynamics is indeed multiplicative as the noise amplitude g{v) increases for increasing speed. 



The latter feature is in marked contrast to the system studied by Yates et al. |370j in which 
the noise amplitude decreases with increasing speed. 

However, despite the consistent nature of the ABP approximation at short and long time 
scales, there exists also a discrepancy between the CMM and ABP models on an intermediate 
time scale. The power spectra of both systems, shown in Fig. [BJ; display a good agreement 
at low to intermediate frequencies and at very high frequencies. In either limits the spectrum 
is well described by Lorentzian spectra, which correspond to those of a two state process of 
velocity reversals (range of low frequencies) and an approximate Ornstein-Uhlenbeck process 
for small-scale fluctuations around the two metastable velocities. For the ABP model, summing 
up these two contributions |344] 

"•^'^ 1 + [irf/rY nv^.n? + (27r/)2 ^ ' 

gives a reasonable approximation of the total spectrum (solid line in Fig. [6]:). The CMM model, 
however, shows one additional feature, which is not captured by the ABP approximation: there 
is a pronounced peak around / = 25. This corresponds to a small-scale damped oscillation in 
the velocity around its metastable states, which cannot be captured by a first-order velocity 
dynamics as in Eq. ([7^ . In summary, the velocity process of the CMM model in all its details 
is more complicated than the simple ABP dynamics even in the limit of a very large number of 
motors. Nevertheless, with respect to the statistics of the velocity and its reversals, to the spatial 
diffusion coefficient, and to the high-frequency fluctuations, the ABP model is an excellent 
approximation. 



3.1.7 Depot model for internal motors and broken friction symmetry 

So far, we have considered active motion induced by negative dissipation either through an inter- 
nal energy depot or an effective velocity-dependent friction. In principle, such active Brownian 
particle models can always be considered as an effective, or "coarse grained" , theoretical de- 
scription of more complex microscopic dynamics leading to self-propelled motion as discussed in 
the previous section (Sec. l3.l3|) in the context of cooperative motion of many coupled molecular 
motors. 

The physics of active transport on the sub-cellular level by such molecular motors and 
of related ratchet systems is a fascinating field of research, which has been under intensive 
investigation for decades now. A detailed review of the field is far beyond the scope of this work 
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and wc refer the interested reader to other comprehensive reviews on the subject jl77l280ll50j . 
Nevertheless, it leads us to a fundamental question, which we would like to address here in the 
context active particles: How can directed, self-propelled motion emerge in simple mechanical 
systems? In the case of directed transport in a ratchet, the directionality is based on breaking 
of the spatial symmetry of the underlying effective potential and in the presence of symmetric 
periodic forces or non-equilibrium fluctuations. 

However, as seen by examples in living systems and technical systems, directed motion is 
possible also without any imposed external spatial asymmetry. The world around us is full of 
creatures like insects, birds and fishes, which are capable to move in a uniform medium by using 
special mechanisms developed in the process of evolution. Most of these creatures use some kind 
of periodic motion in order to propel themselves using specialized "devices" , such as wings or 
fins. The corresponding motion of individuals consists of interchanging intervals of acceleration 
and slowing down, and in a simplified picture we may think of an internal oscillating motor 
driving this periodic motion. Typically the various mechanisms are connected to the head-tail 
polarity of the animals and to periodic changes of the shape of the individual and the related 
changes in the friction with respect to the external medium (see e.g. Fig. [7]). This leads to a 
symmetry breaking in the velocity space, leading to asymmetry with respect to forward and 
backward motion of a polar particle, which allows an effective directed motion even if the 
oscillatory dynamics of the motor are symmetric. Recently, several models for directed motion 
have been proposed which employ similar mechanisms of a broken symmetry with respect to 
an internal degree of freedom j61l246l79l2D5IT5] . 

We consider now the situation where the energy depot is coupled to such an internal degree of 
freedom. Here, we assume that it drives the internal oscillatory dynamics in the inchworm model 
introduced by Kumar, Rao and Ramaswamy (KRR- model) j203] . This new ansatz eliminates 
some shortcomings of the original depot model, such as, the absence of periodic accelerations 
observed in animal motion, or the difficulty to account for the case of large friction (ovcrdamped 
limit) |290| . Let us explain the latter in more detail: Within the original depot model described 
in Sec. 13. 1.31 the dynamics of the energy depot e(t) depend on three constants: q - input rate, c 
- decay rate and d - rate of transmission to energy of motion, which determine the functioning 
of the motor mechanism. From the natural condition vq > 0, it follows that the depot model 
works only if 

7o < . (76) 

c 

This inequality means that the mechanism of the depot model breaks down at large friction val- 
ues and, in particular, in the overdamped limit 70 — >■ oo. However, in many biological examples, 
such as the motion of microorganism at low Reynolds numbers, this is the relevant limit. Here, 
wc should mention the famous "Scallop theorem" formulated Purcell [275j . which states that 
a net-displacement of swimmers at low Reynolds numbers is only possible if the symmetry of 
the motion is broken with respect to time-reversal, which shows the fundamental role of broken 
symmetries for directed motion |120| . 

Instead of considering particular swimming or propulsion mechanisms in the overdamped 
case, we discuss here a simple but generic variation of the depot model, which can be easily 
considered in the respective limit. 

The basic idea of the model is the following: 

1. The energy depot drives oscillations of an internal degree of freedom x (internal motor). 

2. The internal oscillations are transformed into translational motion of the active object via 
a friction function dependent on the internal degree of freedom. 

The varying friction can be realized for example in the following way: We consider a two- 
dimensional ellipse-like object with the axes a and b. Wc assume that the objects moves on a 
line parallel to the larger axis (b > a). Let c be the equilibrium distance between the two focal 
points of the ellipse and the internal coordinate x{t) describe the temporal deviations of the 
equilibrium distance. If x{t) > than the ellipse is more stretched and for x{t) < it assumes a 
more spherical shape. Thus a periodic change in x(t) leads to a periodic change in the friction 
of the object. If further the force leading to a displacement of the center of mass of the object 
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Fig. 7. Left panel: A possible scenario for the dependence of the friction coefficient along the direction 
of motion X on the internal coordinate x coupled to the propulsion force indicated by the dashed lines. 
Right panel: Nonlinear friction depending on the internal distance of the dimer in dependence on the 
amplitude of oscillations according to the KRR model with Fo — 2 and C = 0.8 or jh ~ 3.6, 7; — 0.4. 



X{t) is coupled to the internal variable x (simplest case: elastic coupling), than directed motion 
of the object can be observed despite symmetrical internal oscillations. 

As a model of such a mechanism we consider an object with a large mass M ^ 1, located 
at position X{t) which is elastically coupled to an internal degree of freedom x{t) |290| : 

X = V, MV ^~Mr{x)V + kx + Noise. (77) 

Further we assume the internal degree of freedom (the motor) to have the following dynamics 
driven by the energy depot (see Eq. [52]) 

X = V, i) = {dev — 7o)w — kx — ojqX + noise. (78) 

The dynamics of the internal degree of freedom correspond to an active Brownian particle of 
unit mass in a confining harmonic potential U{x) = (fc + ujq)x'^ /2. The depot energy observes 
the standard balance equation 

e ~ qo — ce + dv^e. (79) 

We assume in our model, that the friction acting on the big mass M in the medium depends 
on the internal motor variable x{t) as in the KRR- model |203j with 

r(a-) = /1)(1 - Ctanh(Ba;)). (80) 

The friction is / q for a; = and decreases with increasing x up a minimal value -Tmin = ^0(1^^") 
for X 00. It increases with decreasing x with -Tmax = ^o(l + C) for x — > —00. The internal 
degree of freedom x corresponds in the original KRR-model to the relative distance of the two 
masses constituting the dimer. 

We see that the motor plays the role of an effective bridge between the energy depot and 
the dynamics of the mass M . The above mechanism of self-propulsion, only seemingly violates 
the principle of mechanics that internal forces do not affect the motion of the center of mass. 
However, internal forces may affect the external dissipation, and may therefore lead to directed 
motion |39ll33l6ll246| . 

In Fig. 13.1.71 we shows an example of the temporal dynamics of different model variables. 
A characteristic feature of the dynamics is the periodic structure of acceleration, velocities 
and trajectories. Similar structures of the trajectories are quite typical mode of translational 
motion of animals. For example, the motion of different organisms such as Daphnia |128j . 
Chlamydomonas [127187] consist of periodically repeating intervals. Each interval contains at 
the beginning a subinterval of strong displacement, corresponding to a large accelerating force 
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Fig. 8. Propulsion via an oscillating internal motor: Internal coordinate x{t) and energy depot e{t) 
(top); external velocity V{t) (center) and position X{t) for two different friction coefficients Jo = 2 
and To = 20. Other parameters: 70 = 0.2, = f , cjo = O.f , A/ = 10, g = I, d = c = O.f , 6 = I, C = 0.8 



and a second subinterval where the displacement is nearly zero. Correspondingly, the velocity 
is a periodic function vifhich alternates between high and low values. In our model this time 
structure is based on the action of a periodically working internal motor which generates the 
periodic accelerations. 

Please note that the above model is only valid if the feedback of the time-dependent external 
friction r{x) on the motor dynamics can be neglected. This approximation may lead to problems 
with the energy balance for example at small k- values and big amplitudes of the friction which 
are neglected here. 
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3.2 Particles driven by active fluctuations 

Another important difference between ordinary Brownian motion and active moving objects 
consists in the possible directions of the fluctuations and their statistical properties. This will 
be the central point of this section and we will distinguish between passive noise terms from 
external sources acting as random (undirected) forces, e.g. the molecular agitation in Brownian 
motion and active from internal noise sources connected with the active dynamics of the particle 
such as its propulsion mechanism. The latter is connected to the actual state of the particle 
including its direction of motion. In the next Section p.2.4p we introduce a fluctuating energy 
supply which will affect the particle's motion in a similar manner. 

We look again at two spatial dimensions and consider polar active particles with the heading 
unit vector as defined in Sec. 12.31 The time derivative of the velocity vector yields 

V = vBh + v4>e^ (81) 

which gives two Langevin equations for the evolution of the velocity v and the orientation 43 : 

V = --i{v)v+ J"(t)e„ (82) 

0= -F{t)e^. (83) 

V 

Let us first concentrate on the random force J^{t) in Eas. ([5^ . Further on, we will distinguish 
two different types of fluctuations, which we will refer to as passive (or external) and active 
(or internal) fluctuations, respectively. Passive fluctuations are assumed to have their origin in 
an fluctuating environment in which the particle moves. In a homogeneous environment the 
passive random force J^p{t) has to be independent on the direction of motion. The prominent 
example of particles subjected to passive fluctuations is ordinary Brownian motion as presented 
in Sec. [31 where the random force is associated with the random collisions of the particle with 
the molecules of the surrounding fluid. Thus, we introduce the external fluctuations in the same 
way as we did for Brownian motion in two dimensions, i.e. as a random noise vector with the 
components of the vector given by two uncorrelated, Gaussian white noise terms with the same 
noise intensity D. The noise vector reads: 

J-p(t) = V2D{^,{t)e, + ^y{t)ey). (84) 

Here, £,i(t) (i = x^y) are 5-correlated, normally distributed random variables with zero mean 
(see Eq. El white Gaussian noise) : 

Mt)) = , (e.(t)0(^')> = 5^j5{t -t'),t = x,y.. (85) 

A second possible model of fluctuations is assumed to have its origin in the internal dynamics 
of active particles. This active fluctuations are a pure far-from equilibrium phenomenon and 
arc relevant in the motion of an biological agents or artiflcial self-propelled particles. The origin 
of these fluctuations can be for example variations in the propulsion of chemically powered 
colloids |260ll64l295j . complex intra-cellular processes in cell motility j313l41) or unresolved 
internal decision processes in animals [2451195(26] . For example, the motion of a macroscopic 
animal moving in a homogeneous environment, where the fluctuations due the environment 
can be assumed as negligible, may nevertheless appear random to an external observer. The 
apparent randomness of the motion stems from internal decisions of the biological agent to 
change its direction of motion and/or its velocity v{t) (internal coordinates). On the other 
hand, for artificial active particles, fiuctuations in a microscopic power engine might occur due 
to its smallness. They may be associated, for example, with fiuctuations in the concentration 
of fuel molecules driving self-propelled colloids (see e.g. |260I295[ ). The important point is that 

^ Note that the angular dynamics diverge for t; = 0. This is due to the fact that we are considering 
point-like polar particles, which for vanishing velocity may turn infinitely fast. This divergence can be 
eliminated by considering finite sized particles. 
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Fig. 9. Visualization of the difference of passive (external) and active (internal) fluctuations (thick 
red/gray arrows), (a) Passive fluctuations £,x{t) and S,y{t) uncorrelated to the direction of motion, (b) 
Active fluctuations ^u(t) and £,^{t) (thick red/gray arrows). Parallel and perpendicular to the direction 
of motion (heading) 



the fluctuating forces are intrinsically connected with the internal propulsion mechanism of the 
active particle. Thus, the corresponding direction of the active fluctuating forces turn with the 
particles orientation. 

We do not intend to resolve the internal processes, and assume for simplicity fluctuations 
in the direction of motion and in the velocity of the agent as independent stochastic processes, 
with possible different statistical properties (see also j268] ). 

Here, we make a simple ansatz for the active fluctuations, as independent Gaussian white 
noise in the direction of motion and in the angular direction e^: 

Ta{t) = ^/2D',^„{t)eh + ^/2D~^^^{t)e^ (86) 

with ^i{t) as defined in Eq. |5S] [i = v^cj)). In the general case we have to assume different noise 
intensities of the active angular and velocity noise: ^ Dy. 

We mention that smaller objects will experience always molecular agitation or the stochas- 
tic character of the external forces. Therefore the general situation is the combination of the 
introduced passive (|84)) and active (|86)) fluctuations. A visualization of the different fluctuation 
types is shown in Fig. [S] 



3.2.1 Quasi-Brownian particles with active fluctuations 

Before we investigate (stochastically) pumped particles, we sketch shortly the difference between 
the two different fluctuating forces by considerating a simple model with linear friction discussed 
in Sec. [5] in the context of ordinary Brownian motion. 

Let us start with particles which are subject to Stokes friction and noise. The case of 
passive fluctuations (ordinary Brownian motion) was discussed in SccO The stationary velocity 
distribution according to Eq.[TT]is a two dimensional Gaussian distribution centered at the origin 
with width D/j. Please note that the simple Stokes friction is apolar by definition (symmetric 
with respect to v — 0). Thus, the heading vector is equivalent to the velocity unit vector 
e/i = e„ = v/|v|. 

The dynamics for purely active noise read: 



_v = -7v(t) + V2A^e,(0C.(i) + ^/2D^e4t)^4t) , (87) 

where the stochastic sources are defined in Eg. 1861 In (u, (/))-coordinates, we obtain two decoupled 
differential equations for the velocity and the angle: 

= -7« + V^Ut) = - V2^e0(i) • (88) 
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Fig. 10. Stationary distributions of a linearly damped particle with internal noise for two different 
noise intensities Dv Left panel: stationary speed distribution po{s); Right panel: Cross section of the 
corresponding Cartesian velocity distribution Po{vx,Vy) 



As t — > (X) the velocity distribution becomes stationary vifithout any preferred direction. It is a 
Gaussian in the velocity v 

P,{v) = Mexp , ^o^*^) ^ 

For the speed s = we derive 

^o(s) = \[P,[v) + P.i-v)) = M cxp (^-^) , (90) 

which in contrast to the Raylcigh distribution (|20|) assigns maximal probability density to the 
state with zero speed. The reverse transformation to Cartesian velocities gives us the corre- 
sponding velocity distribution 

P,{v,vy) = , _ cxp (^-li^J-^j , (91) 

which exhibits a singularity at the coordinate origin {x = 0,y = 0). The distribution is clearly 
a nonequilibrium one. The peak at the origin is due to the many stochastic transitions created 
by ^v{t) which pass through the state with vanishing velocities. In Fig. [10] two examples of the 
stationary velocity distribution are shown. 

The most common situation is the presence of both, active and passive noise sources, with 
different intensities. Therefore we consider 

-7v + J-„(t) + J-p(t) (92) 

where the different noise terms are defined in Egs.lMlandlMl Changing to internal coordinates, 
we obtain the Fokker-Planck equation for P = P{v,(j),t\vo.(t)o,to) with the typical D/v'^ term 
in analogy to polar representation, see (jl9|) . 

dP d {{ D\ ^ , B'^P D + Dsd^P , , 

D, D„ and are intensities of the different noise sources: passive and active velocity and 
angular noise. One can solve for the stationary distribution which factorizes again. Without a 
preferred direction we get again the uniform distribution for the angular dependence which is 
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Fig. 11. Stationary speed distributions po(s) for Stokes friction with active shot-noise fluctuations for 
different values of A/7 = 1/{t^). Solid lines show the result obtained in Eq. llOll whereas symbols show 
numerical results [293) . 

due to increased noise intensity approached at a faster time scale. The velocity distribution is 
symmetrical with respect to w = and reads 

P„(.)=AAH-^Wexp{-^^^L_,.}, (94) 

which for the limiting cases D — > and gives the known distributions and (pn|. 

Due to the symmetry the speed distribution corresponds directly to the velocity distribution, 
with u — > s = |v| and an additional factor 1/2 in the normalization constant Af. Finally we 
obtain the Cartesian velocity distribution to 

Po{v,,Vy) ^ M{vl+vl)^i^ exp{-^^^^^{vl+vl)] (95) 
It reduces the Maxwellian velocity distribution for ~ and the case 

3.2.2 Active shot noise fluctuations 

Active, or internal, noise as discussed is not restricted to Gaussian white noise. We assume 
that an active particle is subjected to white shot noise as introduced in [45| as a limit of a 
dichotomous Markov process. The random "force shots" occur at exponentially distributed 
times ti with the mean interval r or rate A = 1/t The weights hi, which the delta spikes in the 
shot noise are multiplied, are due to the distribution with p{h) with average (/i). 

SsAr(i) = {u+i-U)^T, {h,) = h. (96) 

i 

As the shot noise is the limiting case of a dichotomous Markov process the weights are expo- 
nentially distributed. Subsequently the white shot noise has the properties: 

{^SN{t)) = ^, {^SN{h)£.i{t2))-{^SNf ^^5{h~h). (97) 
The internal driving is assumed to act along the heading direction according to 



_ V = -7V + eh{t)£,sN{t) + v/2^e^e0(i) ■ (98) 

The dynamics are not overdamped, i.e. the shots do not affect the coordinate immediately but 
act as forces pulses on the velocity. The angular noise is assumed to be Gaussian and white as 
defined in 



Will be inserted by the editor 



35 



Distributions of the velocities obtained from simulations are presented in Fig. 1111 For fast 
appearance of subsequent shots with short mean interval r the velocity distribution is approxi- 
mately Gaussian around the mean value of the speed which is h/r (note that the velocity scale 
at the abscissa starts at w = 0). It results in a crater- like distribution in the Cartesian frame. 
Otherwise, in case of rare shots the particles spend much time at the origin leading to the peak 
in the Cartesian distribution. We do not show here the situation where instantaneously the 
crater and the peak at zero exist. 

In polar representation with Vx = v cos((/)) and = v sin(0) the equations of motion become 

1 



V = ~jv + 6(0 4^ = -V^2Ut) . (99) 

V 

The equation for the velocity distribution is independent of the angle dynamics 



oo 

-^^Piv.t\vo,to) = g^jvP - A P{v, t\vo,to) + A / 





dhp{h)P{v - h,t\vo,to) (100) 



The velocity is strictly non-negative and the difference to the speed disappears. In Fig. [TT] 
we present results of computer simulations for three different sets of parameters. Despite its 
simplicity the model features typical properties of active motion like directed motion with 
non-vanishing mean velocity. 

In the stationary limit the (/)-distribution becomes uniform again. The w-distribution can 
be calculated taking the shot-noise limit of the balance equation for the probability density 
function of a dichotomous Markov process. It reads 



pO(w)=7V?;V^ Vexp(-^), t; > . (101) 

Please note that a.s v > the above velocity distribution corresponds directly to the stationary 
speed distribution Po{v) = Po{s). 

In Cartesian coordinates the probability distribution becomes sharply peaked at the origin 
for 1/(7t) < 2: 



P°(z;,,«,) = AA|v|V- ;exp(-^), W\ = ^vl+v'^. (102) 

Examples of the distribution functions obtained from numerical simulations shown in Fig. 
p.2.2[) confirm our analytical findings. We point out that with constant weights the probability 
distribution functions obtained from simulations (not shown) differ strongly from the result 
obtained in Eq. PH^ . 



3.2.3 Nonlinear friction and asymmetric driving 

In the polar representation the shape of the velocity distribution does not depend on the angle 
dynamics, as P{v,(j),t) = P{v.t) P{(j),t\v). On the other hand the angle dynamics depends on 
the velocity since the derivative of (j){t) scales with 1/v. Therefore a full factorization becomes 
only possible in the case of constant velocities or as an approximations. Furthermore the dis- 
tribution function is isotropic in the long time limit (independent on (jj) only in the absence of 
external forces. 

Therefore the consideration of two- and also three dimensional problems with internal noise 
acting on the scalar velocity v{t) simplifies the stationary analysis and many different models 
become tractable. Our third example is motivated by vibrational dynamics and deals with 
nonlinear friction and an asymmetric driving with vanishing mean. Surprisingly this dynamics 
may lead to a directed motion of particles resulting in a non- vanishing mean velocity v. 
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A/7 = 10.000 




Fig. 12. Po{vx,Vy) with internal shot noise, top: The case of fast occurrences of spikes A = 10 and 
damping 7 = 1, bottom: the case of rare generation of spikes A = 0.1 and damping 7=1, Left: 
Simulations; Central: Analytics; Right: cross-sections Po('i^a:,0) analytics (solid) vs numerics (symbols), 
other parameter: a — 1. 



As in vibrational dynamics we will assume nonlinear friction |39) and, in contrast to the 
shot-noise case, stochastic forces acting on the particle with a vanishing mean 

d 



^^v = -7|vr-iv(<) + e„{t)^DMp{t) + y^e^{t)Ut). (103) 

Here, the stochastic term acting on the velocity ^_da/p(0 is assumed to be stochastic force given 
by a dichotomous Markov process (see Sec. 12. 4p . whereas the angular noise is again white and 
Gaussian. 

Prominent types of friction are Stokes friction (n = 1) or the "quadratic drag force" (n = 2) 
occurring for objects moving at large velocities through fluids, e.g. in aerodynamic engineering. 
Another prominent type of friction is the so called "dry friction" with n = 0. 

It was shown by Cebiroglu et. al. |56] , that for a nonlinear friction the particle starts to move 
into the direction of e^, even if the time average of the stochastic force vanishes {{(,DMp{t)) ~ 0) 
as long as £,DMp{t) is asymmetric. This was considered by Blekhman |39| in an investigation of 
trajectories, whereas in [SB] stochastic methods have been used to find the vanishing average. 
The dichotomous Markov process ^DMp{t) can assume two values A± and X± are the rates 
giving the probability per unit time to leave the correspoirding states. The time average of the 
applied stochastic force vanishes if 

(W(t)) = ^+^-+^;'+ =0. (104) 

The asymmetry of ^daip is described by he ratio 



p=\A_/A+\, with 0<p<l, 



(105) 
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Fig. 13. Stationary velocity distributions (Cartesian frame) of particle driven by an internal DMP and 
Gaussian white noise in the angle-dynamics obtained from simulations. The "double-crater" arise due 
to the asymmetry of the forward and backward motion. 



where we assume, without loss of generality, \A- \ < \A+\. 

Here we present only the stationary velocity probability density function 



Pst {v) = N\i+{v)t^{v)\ 



X exp 



/ i+{v')dv' — K- I i-{v')dv' 



where the functions i±{v) are defined as 



i±{v) 



-7|'u|"sign(w) -I- A± 



which due to the applied angular noise is independent on 0. 

The velocity distribution mapped back to Cartesian velocities is shown in Fig. [13] with a 
central peak at the origin and a "double-crater" like distribution. The ring-like maxima of the 
probability density function correspond to the preferred speed values in any direction. The peak 
at the origin stems from the finite probability of vanishing speed, as for particles with Stokes 
friction with active Gaussian velocity fluctuation (sec Sec. I3.2.ip . 

We have simulated [SB] the two dimensional situation 

^r(t) = v(t) while w{t) = v{t) ■ eh{t) . (106) 

and two paths of realizations are shown in Fig. 1141 

The particles have a nonzero average speed. The diffusive motion is becoming stronger if the 
asymmetry vanishes p — >■ 1, which is reflected in the diffusion coefficient shown in Fig llll This 
growth is caused mostly by the variance of the velocities which scales the diffusion coefficient 
and which increases if the strokes becomes more symmetric [SB] . 
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Fig. 14. Particles with nonlinear friction subject to DMP fluctuations with vanishing mean. Left: Two 
paths of particles in two dimensions for different asymmetry of strokes. Right: Diffusion coefficient for 
different exponents in the friction coefficient ()103|) as function of the asymmetry [56] 



3.2.4 Fluctuating energy depots 

Another example where noise depends on the orientation can be discussed within the depot 
model. We so far assumed a permanent food supply. Here we study the situation that the food 
supply occurs randomly and underlies stochastic influences. Doing so, we extend the model 
with energy depot (see Sec. I3.1.3|) to the case that the energy is provided at discrete times with 
packets of chemical energy which is subsequently converted into acceleration of motion |325| . 
In contrast to mechanical external noise which has not preferred direction, such energetic noise 
is directed likewise an internal noise and acts into the direction of motion. We assume, that 
alterations of the direction have a different origin than the energetic noise supply. 

We propose here an oversimplified model ^325] and assume that the food supply is a Pois- 
sonian shot noise process as it was introduced in Sec. (|2.4|) . More precisely we assume that the 
particles are supplied at discrete times with packets of chemical energy which is subsequently 
converted into acceleration of motion. This should model the situation that animals, birds. 
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Fig. 15. Typical trajectories in the smooth regime (left, r — 0.05) and shot regime (right, r = 5). The 
simulation times are equal for both figures, however the length scales are different. Other parameter 
values: go = 1, D = 0.01, 70 = 10, c = 0.1, d = 10 [325] . 

insects or bacteria pick up nutrients at different, randomly distributed times. For simplicity we 
assume that the time intervals between the food-supplies follow the pattern of a Poisson point 
process |224l254l52l71ll06ll90l377j . Possible application to ratchet problems with energy supply 
modeled as shot noise imposed on Brownian motion have also been presented |96lll9llT8] . 

We relate a shot-noise driven energy depot with the Brownian dynamics of individual parti- 
cles. We adapt the picture in which the energy depot accelerates the particle along the direction 
of motion with the strength d [9611181307110113^ as introduced in Section 13.1.31 The new as- 
sumption is that the carried energy in the depot e(t) now obeys the stochastic balance equation 

^^e = q{t)-{c + dv^)e. (107) 

Therein the function q{t) corresponds to a shot noise consisting of energy packets hi which are 
exponentially distributed with mean h and arriving at discrete times ti with rate A = 1/t. The 
time average of the shot noise process is denoted as {q{t)') = qo = h/r. 

In the case of vanishing mechanical noise, we obtain two stationary solutions for the velocities 
averaged over the stochastic food supply. The first is resting with (vi) = 0, (ei) = qo/c and 
the second stands for running with (V2) = 90/70 ~ c/d, (62) = '^o/d. Therefore dependently 
on the energy supply, the system exhibits two different regimes. When the energy input is high 
enough, the particle moves at a non-zero velocity. If the energy input is too small, the energy 
fluctuates but the velocity remains zero. 

Further on, we can distinguish two limiting cases [325] : (i) The smooth regime: Here the 
shots are so dense that the mechanical system sees practically a continuous flow of energy. This 
is the case, when the mean time interval between two shots (tshot) = t is much shorter than 
the timescale of the decay of the energy depot = l/{c + dv^). Now we insert the stationary 
solution for the velocity, Eq. ([501 DM). Then we speak of a smooth regime when the rate of 
the shots 1/t ^ dqo/jQ. In this situation, the stochastic food supply can be well approximated 
by Gaussian noise, (ii) The shot regime: The shots arrive so seldom that every shot is a special 
event which accelerates the particle. This is the case when the mean time interval between 
two shots is much longer than the timescale of the decay of the energy depot, i.e. the rate 
1/t < dqo/jQ. 

Typical trajectories and energy distributions of the smooth and the shot regime are shown 
in Fig. [15] and Fig. [TC] Note that the mean energy input is equal for the two regimes. In the 
smooth regime, the energy shows a maximum at e = 70/d. In the shot regime we observe a 
maximum at very low energies and additional smaller maxima at multiples of h. The maximum 
at low energies occurs because the particle converts the available energy from the depot to 
kinetic energy much faster than the average time between two shots. The maxima at multiples 
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Fig. 16. Energy distributions for the smooth regime: (left r = 0.05) and shot regime (right, r — 5q). 
qo = 10, other parameter values as in Fig. ITS] [325) . 

of h occur when multiple shots of energy arrived before the particle converted the energy of the 
depot to kinetic energy and accelerated its motion. 

Now we will concentrate on the impact of the shot noise and set the external Gaussian white 
noise acting on the velocity D to zero. Like in Sec. (|2.4p we will treat the white Poisson shot 
noise as a limit of the dichotomous Markovian process (DMP) [71I377I45I125) . This will allow 
us to derive an expression for the stationary probability distributions for velocities and energy. 

Because of our shot noise source does not change the direction of the velocity it acts like 
an internal noise as introduced previously. Therefore we may restrict the consideration to the 
motion along the direction of motion. We change to the polar representation and get 

s = (de-7o).s, e ^ q{t) - e[c + ds^] . (108) 

Please note that the polar representation is equivalent to the internal coordinates as the velocity 
can assume only positive values s{t) ~ v{t) > 0. In the following we will discuss two cases for 
which we can specify the stationary distributions. 

(i) Adiabatic approximation: For qq ^ 7q /d we use the adiabatic approximation e « and 
insert e{t) = q{t)/c + ds'^{t) into Eq. ([TU5)) . 

dv 

S^~10S + -^^^{t) - f{s) + g{s)q{t). (109) 
Following the approach that q{t) is a limit of a DMP we obtain 

Po(s) A/" s(^"^"^) cxp| - ^1 . (110) 

(ii) Static regime: For q^ < cjo/d the system is in the static regime, so that s = 0. Therefore 
the dynamics reduces to 

e = q{t) - ce. (Ill) 

we obtain 

Po(e) = AAe^ exp{ - -^j. (112) 

The second term of this expression yields a monotonous decreasing for all parameter values. 
The first term is monotonously increasing if cr < 1 and decreasing otherwise. Therefore the 
probability distribution of the internal energy shows a maximum in the static regime when 
1/t > c. 
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Fig. 17. Speed distribution and theoretical estimate (solid line, Eq. I116p . Parameter values: 70 — 
0.1, c = 0.01, d=l,D = 0.1, go = 1, r = 0.01, = 0.01 [325] 

In another limit, we consider small mean time interval r between the spikes and low mean 
amplitudes h. We assume that the energy input contains a constant and a fluctuating part, 



qit) = qa + vit)- 



(113) 



where qo is the mean value of the energy input. We approximate the fluctuating part as Gaus- 
sian white noise r]{t) = y^2i5^ ^q{t)- According to [IS], white shot noise with exponentially 
distributed weights hi converges to Gaussian white noise in the limit t — >■ 0, ft. — )■ with 
constant noise strength Dg = /i^/r = q^r. The parameter G of ([34]) than vanishes. 

If the energy follows changes in the velocity very fast, we can assume that the energy takes 
quickly values such that e in (|107[) . We solve (|107p for e(t) and insert the expression into 
the equation for the speed. Afterwards, we obtain in Cartesian coordinates an additive external 
noise and a multiplicative internal noise caused by the fluctuating energy supply 

In polar coordinates we obtain the following equations of motion: 




- 70 s + 



(114) 
(115) 



Therein £,s{t), ^^{t) are due to Eqs. P^ . 

The total noise in both equations consists of two terms, (1) the standard white mechanical 
noise, which has no preferred direction, and (2) the driver noise which is directed pointing to 
the direction of the velocity e„ = v/s. As a result, the shot-noise affects only the speed. 

From the two equations we obtain the corresponding Fokkcr-Planck equation and look for 
the stationary solution. It reads 



Po{s) = Ms 



D + D„ 



where the potential 



<?(s) 



ds' 



ds 



dqo 



70 



cxp[— «Z>(.s) 



(116) 



D, 



D + Da 



(117) 
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In the limits of this approximation the analytical result fits well the numerical simulations as 
seen in Fig. [171 



3.3 Active Brownian particles: active versus passive fluctuations 

Now we consider active Brownian particles with an intrinsic polarity defined by the heading 
vector B/i (see Sec. 12. 3p . In case of the Schienbein-Gruler friction pS)) . the equations of motion 
with both passive and active noise (See 13. 2. Tl Eas. IMl in u, ^-coordinates read 

^v = -foivo~v) + V2D{^,it)cos<j) + ^y{t)sm^) + ^/2D^^,{t), (118) 



dt V 



(\/2l?(-ex(t)sin0 + ey(t)cos0)) +^2D^^^{t). (119) 



The above Langevin equations equations have multiplicative noise terms and the corre- 
sponding Fokker-Planck equation for P{v, (j),t\vo, 4>o,tQ) again gets the Stratonovich shift and 
reads: 

ot ov [ V ov J v' oq)'^ 

Please note that the angular diffusion given by the last term of the above equation depends 
directly on v{t). In the case of vanishing external forces (Fext = 0) there is no distinguished 
angular direction. The stationary distribution with respect to (j) is homogeneous and we may 
write Po{v,4>) = Po{v\(j)) / {2tt) whereas Po{v\(t)) has to fulfill the following equation: 

= -l{{~liv)v + ^)Po-iD + D.)^^Po] (121) 

By inserting the Schienbein-Gruler friction (|46p and solving the above equation we obtain the 
stationary velocity distribution for any given heading angle as 

P.H*)..VWrffce.p{-||^}^ (122, 

This is the general solution for the probability density function of the velocity with respect 
to the heading in the presence of both noise types. In the following we discuss the stationary 
distributions for the two limiting cases of only passive and only active fluctuations. 

The stationary velocity density for only passive fluctuations can be directly obtained from 
(fT22)l by setting D^, = to 

Poiv\cb) = MM exp |-2:2i!^_!^| . (123) 
The inverse normalization constant in this case can be calculated using P{v\(j))dv = 1 to: 



This result is conflrmed by the velocity distribution obtained from numerical simulations of the 
Schienbein-Gruler model in two dimensions (SG2d-model) with only external fluctuations as 
shown in Fig. 1181 At vanishing noise intensities -D/70 — >■ the distribution converges towards 
a i5-peak at vq. With increasing noise intensity it is approximately given by a narrow Gaussian 
around vq. With a further increase in D clear deviations from the Gaussian distribution become 
evident by the appearance of a second maximum of the probability density at negative velocities, 
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Fig. 18. Stationary speed distribution Po{s) of the Schienbein-Gruler model with external noise for 
different noise strengths: Analytical solution obtained from (|125p (solid line) and numerical results 
(symbols). The insets show the corresponding plots for the velocity distributions Po{v) (|123|l . Other 
parameters 70 — 1.0, vo — 1.0 



D = 0.l 




Fig. 19. Stationary velocity distributions Po{vx,Vy) of the SG2d-model with external noise for different 
noise strengths: D — 0.1, top; D = 0.5, center; D = 1.0. Left column: Results obtained from Langevin 
simulations; Central column: Analytical solution given in Eq. (|47p : Right column: One dimensional 
cross-sections Po{vx,0) comparing analytical solutions (solid lines) with numerics (symbols); Other 
parameters 70 = 1.0, ?;o = 1-0 
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caused by backwards motion of the particle with respect to its heading. The action of the 
external fluctuation leads to a vanishing probability of w = 0. Finally at D/70 the distribution 
approaches a symmetric distribution which corresponds to the Rayleigh-distribution mirrored 
along V — 0. 

In polar representation f — )■ |w| = s the corresponding speed distribution along any given 
angle (/) is a symmetric superposition of particles moving forward and backward with respect 
to the corresponding heading direction: 



AMp s exp I - 



70 (s - wo)^ ■ 



2D, 



I r 270 51)0 1 



(125) 



Please note that Pq{s,lp) differs from Po{v,(p) as it is only defined for positive speed values. 
The constant factor A ~ (27r)^^ is determined by the normalization with respect to the angular 
variable. 

In analogy to Po{v) for D/70 — > 00 {vq 0) the distribution converges to the Rayleigh- 
distribution of ordinary Brownian motion (see Ea. l20p . whereas for -D/70 — > the limiting distri- 
bution is a (5-distribution at vq. Finally we obtain the stationary distribution in Cartesian coor- 
dinates Po{vx,Vy) from the stationary distribution in polar coordinates Pq{s,(I)) = Pq{s)/{2'k) 
by corresponding coordinate transformation and we obtain Eq. (|47p . Examples of Pi:i{vx,Vy) 
are shown Fig. [Tni 

For only active fluctuations [D = 0) the stationary velocity probability density (|122p be- 
comes a Gaussian centered at vq with width £)„: 



Po(v|(/') =A/'aexp{ - 



7o('" - ^^o)^ 
2D,, 



(126) 



with Ha ~ vTo/SttI)^. The normalized probability density function in polar coordinates reads 



-Po(s, v) 



(27r)3/2 



exp ■ 



70 (s - '^o)^ 
2D, 



\ 1 , f 27ost^\ 



(127) 



We emphasize the non- vanishing probability density at s and the corresponding absence of 
an increase of Pq for small s as shown in Fig. [20l This atypical behavior indicates that there is 
no limit where Pq{s) converges towards the Rayleigh-distribution. 

The probability density in the Cartesian velocity coordinates , Vy can be directly obtained 
through the corresponding coordinate transformation to 



^o(v) 



1 -I- exp <^ - 



2701^ 1^^0 ■ 
D„ 



I exp I 



7o(|v| - «o)' 
2D, 



(128) 



with 



Please note that the velocity probability density function in Cartesian 



coordinates diverges for = 0^ Vy 
origin as shown in Fig [5TJ 



and as a consequence exhibits a sharp peak close to the 



3.4 Particles with Internal Motor Control 

3.4.1 Propulsion of particles in arbitrary direction 

Here we discuss briefly several concepts describing the two-dimensional dynamics of particles 
with motor, where the motor is included in the dynamical description. We note at first that polar 
particles have an internal direction. It was defined in Section 13.1.21 by the tail-head structure 
expressing the spatial structure of the particle. In a similar way, one could speak about polarity 
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Fig. 20. Stationary speed distribution Po{s) of the Schienbein-Gruler model with internal noise for 
different noise strengths: Analytical solution obtained from H127|) (solid line) and numerical results 
(symbols). The inset shows the corresponding velocity distribution Po{v) given by a Gaussian p26[) . 
Other parameters 70 — 1.0, vq — 1.0 |293| . 



A, =0.1 




Fig. 21. Stationary velocity distributions Po{vx,Vy) of the Schienebein-Gruler model with internal 
noise for different noise strengthsiTop D — 0.1, bottom: D=0.2. Left column: Results obtained 
from Langevin simulations; Central column: Analytical solution given in Eq. 11281 Right column: 
One dimensional cross-sections Po{vx,0) comparing analytical solutions (solid lines) with numerics 
(symbols); Other parameters 70 = 1.0, ?;o ~ 1-0 |293) . 
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in the presence of a dipole moment, magnetic moments or other features playing a role in the 
interaction of particles, or in the dynamical response to external forces. This may introduce a 
polar head-tail or left-hand asymmetry and define a distinguished direction characterizing the 
particle. 

We have connected this polarity axis with the direction of motion ei,(i). It corresponds for 
positive velocities to the heading vector eh{t), whereas for negative velocities with respect to 
the heading both vectors are anti-parallel. It is a situation similar to a moving ship where the 
positive and negative directions of velocity are parallel to the bottom of the ship from the bow 
to the rear, but the velocity points differently to the heading for a ship moving "backwards". 
Both vectors have associated angular unit vectors, we recall that e^{t) describe rotations of the 
heading and (t) rotations of the velocity, respectively. 

So far in most cases, we also put the non-random propulsion parallel to the velocity (Excep- 
tions are torques which act perpendicularly). This parallelism now will be dropped, in contrast 
to the previous sections, we will now assume that there exist no strict and fixed relation between 
the velocity (or polarity) and the propulsive direction. We will explicitly allow for a propulsion 
mechanism that acts in a direction which is different from the direction of motion (see e.g. 
|334ll08| ). 

We define a new direction, which we will connect with the action of the propulsive motor. Let 
B.p(t) the acceleration associated to the propulsive force, which an active particle experiences 
from the action of an internal motor. The associated unit vector is ep{t) with direction cosines 
{cosx(i),sinx(t)}. Here, x(t) is the angle between the axis of abscissas and the considered 
force. We also introduce the magnitude of acceleration ap{t) by 

ap(t) = ap{t)ep{t). (129) 

An active particle with unit mass (m = 1) obeys the dynamical equations: 

§=v ^ = ap(t) -70 V + Fext + V2^eW- (130) 

Here the propulsion acts in direction of the unit vector ep{t). Furthermore, the particle is driven 
by external forces Fg^tj by linear Stokes friction and by noisy agitations, which might be passive 
or active. The treatment of the latter was described in the previous sections. 

Because propulsion and velocity vectors are not parallel anymore, the vector eh{t) and its 
associated angle are not uniquely determined as they were in the previous sections. We define 
in this section that the particle starts at time t = always with positive velocity and that in 
this case e;i(0) = e„(0) independent of the acting force. By the temporal evolution no further 
ambiguity occurs. 

We expand the propulsive acceleration again along the eh{t) and the perpendicular unit 
vector e^{t). Consequently, we formulate 

SLpit) = ah{t)eh{t) + a^{t)e^{t). (131) 

Then, without noise and if the external force acts along the x-axis Fg^t = , it follows for 

the dynamics of the particle 

^ = a/i(t) -7ow + Fa cos (t){t) = a^{t) ~ Fq sin (l){t). (132) 

dt dt 

where v{t) is again the projection of the velocity-vector v(i) on the heading axis e/j(t), which 
is defined by the actual angle (t){t). If we insert explicitly the direction of the propulsion, the 
corresponding dynamics becomes 

^ = ap{t) cos{x - (t>) ~7ov + Focos(j){t) ^' ^ ap{t) sm{x - <j)) - Fq sin (t>(t) (133) 

For the simplest case of a constant propulsion a.p(t) = slq pointing along a stationary angle xo 
and without external force Fq = 0, the angle (/)(i) turns into the direction of the acceleration. 
Asymptotically, we get 

0(i oo) = (l>o ^ Xo , '"{t oo) ^ ao/7o . (134) 
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Therefore, we find that the particle behaves asymptotically like it would follow a Schienbein- 
Gruler propulsion, i.e. the propulsion coincides with the direction of motion and in the simple 
case in which we obtained a stationary speed. 

For a non-vanishing external force Fq ^ 0, the particle is pulled in direction of the x-axis. 
If now the propulsion has constant magnitude oq and direction xo the stationary solution can 
be found as well. The asymptotic angle of direction 0o obeys 

tan(^o = -^r-r (135) 

Fo + Gp cosxo 

which follows also easily from a geometric construction in response to the action of two constant 
forces. In result, the stationary direction of motion is always sensing between the propulsive 
force and the x-axis. For the magnitude of the stationary speed, one obtains 



vo = — JPg + al + 2 apFo cosxo (136) 
70 * 

which behaves as the value of a scalar product. 

Within our more general framework, we briefly summarize the propulsion functions which 
we have used so far or will use later: 



Schienbein and Gruler |300| have found empirically the following simple "ansatz" for the 
cell dynamics (|46p 

ah = 70^0 = . (137) 

The polarity axes coincides with directions of motion. In perpendicular direction normally 
angular noise is applied. 

In case of the Rayleigh-Helmholtz pump with ci = a — 70 > in (|130p we defined ([^^ 

ah = {av - Pv^), a^ = 0. (138) 

Again the pump induces a acceleration parallel to the current motion and there is no sys- 
tematic torque applied and in </> direction we apply noise with vanishing mean. 
Note that the propulsion in this case has no preferred action along the polarity axis. It is 
impossible to distinguish between forward and backward motion along the polarity axes of 
the particle. The propulsion acts symmetrically in both positive and negative directions. 
In the frame of the the energy depot model, the stored energy e{t) was transformed into 
kinetic energy with rate d as (see Eq. [5^ 

ah = de{t)v{t) , 00 = 0. (139) 

The internal motor increases kinetic energy in direction of motion. 

The case with constant speed v(t) = vq eh(t) and random or systematic turning angle: The 
propulsion in directions of motion has to compensate at least the friction force. The angular 
dynamics can be systematic, for example, circling with constant torque Qq 7^ 0. It can be 
as well a function of the orientation if additional forces affect the motion anisotropically. Of 
course, random torques with Gaussian nature or shot noise and other time-dependent noise 
acts on the orientation. This case can be characterized with large 70 —> 00 by 

ah = 70^0, a^ = n{vo,(l){t),^{t),t) , (140) 



where f^{vo, (l){t), S,{t), t) shall describe the mentioned influences. It will be presented in more 
details in next sections. 
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3.4.2 Navigation in space following a given protocol 

The human motion control of objects, say the steering of a ship or airplane or the driving of 
cars usually involves some moving task or protocol of navigation. There is a leader, the driver 
or captain, who has to follow a given optimal route in spite of stochastic forces and factors as 
wind, nonuniformities of space, etc.. In animal mobility, the tasks are more modest but anyhow 
they do already exist in elementary form. An animal has to find food and shelter in a landscape 
with given geometry, with some distribution of food and shelter. 

In order to describe such phenomena in a two-dimensional spatial set up, we have to assume 
at first a coordinate system in which the protocol can be defined and applied. We propose that 
the protocol contains the information about the current state of the propulsion mechanism or 
of the motor of the active particle. We will assume that this state can be characterized by a 
velocity-like vector w(t). At every instant of time, it has a direction given by the unit vector 
e.u, with components e„, = {cos sin in Cartesian presentation and is defined by the 
magnitude or by the length of the vector w(t). 

Both values w(t) and v{t) together make up the protocol and will define the performance 
of the motor over the considered time. In addition to the position and velocity, they are new 
variables describing the momentary state of the running motor. Changes of the motor in magni- 
tude and direction induce a propulsive force which is exerted on the particle. The corresponding 
acceleration has two components 

ap{t) = a^{t)eUt) + a^{t)e^{t). (141) 

resulting either from a change of magnitude or of direction 

a™ W = 4 w{t) , cL,{t) = wit) i^{t) ^ wit) nit) . (142) 
at at 

and we have set i^it) = Q. Both components of vanish for a constant activity of the motor. 
The direction of the common action from the two items differs from the direction of motion 
e„(t) and from this of the protocol Qy^it)^ in general. 

The function w(t) would define a ideal course of the particle parameterized in time. In the 
absence of other forces, the performance of the particle would follow the protocol: 

Vid(t) = w(t) . (143) 

With a respective initial condition, one would get the ideal course 

t 

rid(t) = ro + j dt'^it') (144) 
which is the wanted path in the considered coordinate system. 



3.4.3 Navigation in space: The general case 

In more complicated cases, the time-dependent protocol is unknown and the temporal evolution 
of the motor variables wit) and vit) has to be defined as the solution of a given dynamical 
problem. In general, it is reasonable to assume that the two functions obey first order differential 
equations 



— = /„(r,v,w,t) + v/2A^^«,(0, — - /,(r,v,w,t) + v^C.(0- (145) 

The and ^i, stand for motor noise with corresponding intensities. In particular, the solution 
of these equations can be also defined as a control problem, in which one has to find the correct 
temporal forcing in order to follow a given route under given loading. 
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The existence of the "internal veetor" w(t) determining the direction of the propulsion by 
Eq. ()143|) turns the point-like particle into a Brownian particles with time-dependent propulsion. 
This new dynamical feature in the description of the Active Brownian particle leads to an 
extended state space which includes the new state variables w(t), respectively w{t) and v{t). 
The situation is similar to the case of active polar particles discussed recently by Szabo et al. 
|334| or Enculescu and Stark |108j . In our new frame work, the active Brownian particle is 
defined by the position r{t), by the velocity v(t), and by the vector w(t) or by the Langevin 
equations for position and velocity supplemented by Eqs. (|145p for the motor. 

The Langevin dynamics includes the acceleration exerted by the motor, linear friction, an 
external force F, and noise (again we set m = 1, leading to 7 = 70): 

^ = V ; ^ ^ w{t) e^{t) + w{t) f2{t) e,(t) - 7 v - F + V2D^{t) . (146) 

Here, the motor creates an acceleration with magnitude a{t) acting in the direction of action 
x{t). ... 

It is instructive to first consider a simplified system. We assume that the acceleration in the 
direction of the motor is some constant and take for simplicity jwq. This choice is equivalent 
to a Schienbein-Gruler propulsion. Furthermore, we replace in the angular acceleration the 
velocity in front of the angular frequency by the asymptotic constant value wq. Doing so, the 
propulsion term reads 

ap(i) ^jwoe^^ +wof2{t)e^. (147) 

These assumptions lead to 

^ = z;o7e., - 7 v + van{t)e, + F + V2D ^{t) , (148) 
at 

which is similar to the problem in Ea. (jl32[) . The only difference is the third term, which describes 
a rotation of the particle as consequence of a change of direction of the motor z>(t) = f2 7^ 0. 

Next, we consider a constant external force, which acts in a;-direction F = Foe^;. We project 
the Langevin equation onto the vectors e^, (t) being parallel to the direction of motion and the 
perpendicular angular direction e^. In result, we obtain 

dv 



— = 7W0 cos(:^ — 0) — 7w + Fq cos(/) -I- Wo ^(t) sin(</i — + y^2Dy^y{t) 
dt 

d(j) 



(149) 



i; — = 7Uosin(z^- 4>) -f i^osin^ + WQn{t) cos(i/ - (f)) + ^j2D^^^{t) 



One easily sees, that without external forces and with a constant direction of the motor vq the 
direction (f> of motion of the particle will asymptotically follow vq. Since items with Q which 
is zero disappears the resulting equations are identical to the situation explained following 
Eq.(II321). 

In other cases, the angular driving n{t) = vit) is not defined as protocol and has to be 
defined. The description comprises the dynamical equations for the motor. For example, a 
wanted time and space dependent route VQ{v,t) may be given e.g. by the relaxation dynamics 

f2{t) = v{t) = -- {v{t) - vo{v,t)) , (150) 

T 

with some relaxation time t. For the particular fo(r, t) one may find from this equation vit) as 
a function of time and insert the solution into Eq. p49p in order to solve for ({){{) and for v{t) 
and hence to obtain the complete trajectory. 

As a further example, we consider a circling body. For this purpose we suppose constant 
motor load 7W0 and constant torque J7oj i-C 

w = 7W0, !> = J?o ■ (151) 
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We simplify to the case without external force Fq = 0. Then the particle follows the rotating 
motor with the same angular velocity 4> = Qq- The constant difference of the angles A = (/) — f 
and the stationary speed vq is determined by the two equations 

7 uq = J Wo cos A -\- Wo sin A , [2 vq = ^ wq sin A -\- wq f2 cos A . (152) 

for given motor load wo and ]7. They are solved by 

cosZ\ = — . (153) 

Wo 

The stable solution should obey Z\ = — > 0. For the speed of the circling particle one 
obtains ^ 

which becomes maximal if the dissipation is weak, i.e. 7 is small. In this case, the velocity 
becomes approximately wo and the difference of the angle between motor and particle vanishes. 

Generally, the motor works with maximal efficiency (maximal speed) if the direction of 
the motor agrees with the current velocity vector. Therefore, an important requirement is 
a minimization of the deviation between ^{t) and (j){t) also in the case when i>{t) changes 
permanently. One possibility to implement this requirement would be an adaptation dynamics, 
in which i'{t) approaches (j)(t) with a positive rate q > 

m = -q[v{t) - 4>{t)] . (155) 

More generally, the dynamics for v may be described in terms of a potential 

^oc-^fci). (156) 
dt dv ^ ' 

With the particular choice U{v — (f) = —qcos,{v ~ (j>) the motor will also follow the current 
velocity, in case q 00 both directions converge and the motor dynamics reduces to forces 
which can be interpreted as negative friction. In general, the outlined search for obtaining a 
maximal speed defines a problem of optimization. This problem is then similar to that of the 
navigation problem of a captain who selects the direction of his ship by turning the rudder and 
the speed by changing the motor power. Finally, we mention that one can also assume that the 
direction of motion in the dynamics is delayed by a fixed period, i.e. 4'{t — t), with r > 0. 

Particularly important in our review will be the case that the motor is driven by random 
forces. We will discuss this point in more detail in the next Section, where wc consider the 
diffusion of active particles. Already a first inspection of the Eqs. (|149p shows that the action of 
isotropic random alterations of the motor will not result in a preferred direction. Nevertheless, 
the random action of the motor will induce a diffusional spread over the free space. The respec- 
tive diffusion coefficients and distribution functions in confined geometries which quantify this 
behavior will be the topic of the next two Chapters (0] and [5|) . 
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4 Difrusion of active particles 

In this Section, we discuss several aspects of the undirected spatial spreading of active particles 
in absence of external forces, i.e. diffusion of free active particles. Diffusion is not only a funda- 
mental feature of random motion and the mean squared displacement and the corresponding 
effective diffusion coefhcient are characteristic observables easily accessible in experiments. 

The properties of diffusive motion have important biological implications if applied to animal 
searching behavior as they have a major impact on the ability of individuals animals to exploit 
spatially distributed patches of nutrients (see e.g. [1951302120119] ). As a starting point, before 
discussing different aspects of diffusion of active particles, we will give in this context one 
example for the importance of the value of the effective diffusion coefficient [1951302] . Other 
examples from ecology have been discussed by Okubo and Levin [247] . We intend to show that 
simple organisms might gather different amount of food in dependence on the value of the 
spatial diffusion coefficient. It will be of special importance that the food is localized, say in 
bounded regions which extend over a finite distance only. If then the organism has only a finite 
time for foraging his strategy to locate a maximal amount of food is obviously an object of 
optimization as recently outlined by Moss and coworkers [128176175] . 

Assuming that the density of the independent organisms p(r,<), thus the single individual 
probability distribution, obeys a diffusion equation with a diffusion coefficient Dr 



In two dimension the resulting probability density in space is 



(157) 



P(r,i) 



1 



exp 



ADrt 



(158) 



We assume that the particle consumes with constant rate k a food C, which is given by its den- 
sity c(r,i), during its random motion. The food is stationary in space. Hence the consumption 
of food is described by 

^c(r,i) = -fcc(r,i)p(r,0 (159) 



The latter equation can be solved exactly if the solution ([158p is inserted. Simple quadrature 
gives 



c(r,t) = co(r) exp 



With the definition of the exponential integral [2] 



kp{r,t')dt' 



(160) 



Ei(l,a) = / ^^'^ ^ At 



(161) 



we obtain in compact form 

c(r,i) = co(r) exp 



k ^ I r 
Ei 1, 



47rL>. 



ADrt 



(162) 



where we used <o = 0. 

We consider now bounded distributed food patch. As a prototypical distribution we take a 
circular patch with radius R where C is present. Outside of the patch no food is located. For 
simplicity we assume the circle positioned at the origin, i.e. 



co(r) = Co = const., if |r| < R. 



(163) 



52 



Will be inserted by the editor 





I 
J 


1 1 1 1 


1 1 1 1 1 




ft 





_ 




0.8 









0.7 


■ 


' 




0.6 






1 


0.5 
















0.4 


if ^^^""'''^•^ 














0.3 








0.2 








O.I 











1 1 1 1 


1 1 1 1 1 



0123456789 JO 
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Fig. 22. Fraction of food gathered, which can be obtained using Eq. p64p . as function of the dimen- 
sionless diffusion coefBcient for three values of the clearance rate: fc = 1 (solid line), fc = 1 (dashed 
line), fe = 5 dotted line. The gathered food is expressed as a fractions of the original total amount [128| . 



and vanishing food concentration, elsewhere. Then after a fixed time T wc determine the overall 
food which is still left. It results from integration |302) 

R 

CiT) = 2ttco J exp 



Inspection of this expression shows that there exist a minimum with respect to the diffusion 
coefHcient Dr- Thus the variation of the effective diffusion coefficient gives rise to a change 
in the overall food consumption. One might speculate that in nature the effective diffusion 
coefficient has been optimized for maximal foraging success jl28l76l75] 

The fraction of consumed food (C(0) — C(T))/C(0) as a function of the diffusion coefficient 
is shown in Figure [HI We have chosen the spatial diffusion coefficient Dr with respect to the 
normal diffusion coefficient Dn = /4T to cover the given sphere with radius R in time T and 
assigned 5 = Dr/Dn. A simple explanation can be given as follows. If the diffusion of particles 
is very large, e.g. they move almost exclusively straight forward, they will quickly leave the 
food patch. On the other hand, staying localized due to low diffusion coefficient, e.g. jumping 
permanently forwards and backwards, is also disadvantageous as the particle spends a lot of 
time in the region where it already consumed the food. Hence there exists an optimal diffusion 
coefficient, for which the particles spend the most time within the food patch and are able to 
consume the maximal amount of food. It does not matter whether they start at the center of 
the food patch or not. 

This situation is illustrated in Fig. [23] where particles hop with exponentially distributed 
turning angles 

P{Aip) = CT exp(-cr|Z\(^|) (165) 

and a constant hop length |128j . Between two hops they rest a random time (with mean (^t) = 
0.25) and consume food. In Fig[23l the consumed food for three different width's a of the turning 
angle distribution is shown. The large circle depicts the finite radius of the food patch. It is 
seen that an optimal width leads to a maximal consumption of food from the patch. 



Ei 1, 



'dr. 



(164) 
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Fig. 23. Traces of food gathered by active particles for different widths of an exponentially distributed 
turning angle. The particles hop according to the turning angle distribution a finite step and rest a 
finite time in every new position gathering food; Blue: a — 0.1, green: a — 1.2 and magenta: a — 10, 
for ballistic, correlated and uncorrelated motion, respectively [128] . 

4.1 Taylor-Kubo relations for the diffusion coefficient 

An interesting yet nontrivial question about the dynamics of active particles concerns their 
diffusive behavior in the simple situation in which there is neither interaction with other active 
particles nor nonlinear external fields. In these situations it is of interest whether the Active 
Brownian particles exhibits a mean drift with non- vanishing mean velocity (v), possibly due 
to an asymmetry in its friction function or due to some interaction between the friction and 
the driving noise. Furthermore, it is not clear a priori whether the active particle will execute 
a normal Brownian motion or whether for certain friction functions anomalous diffusion may 
be observable. In many cases, it turns out that active Brownian particles perform just nor- 
mal Brownian motion with a linear asymptotic growth of the mean square displacement. In 
these cases, however, it may still be surprising how the diffusion coefficient depends on system 
parameters as, for instance, the noise intensity. 

Generally, if the velocity dynamics obeys a stationary statistics, we may express the mean 
square displacement (m.s.d.) Ar^{t) = (r(<) — r(0))^(t) by the velocity auto-correlation function 
via the Green-Kubo relation. For convenience, we set the initial position to r(0) = and 
can thus express the position at t by the integral over the velocity vector J* dt'v{t'). First we 
assume vanishing stationary mean velocity (v) = 0. By inserting this into the m.s.d., exchanging 
integration and averaging, using stationarity, and simplifying the integrals, one arrives at 



If the stochastic process governing the evolution of v is stationary, the expectation value 
of (v(t')v(t")) depends only on the absolute value of the time difference r = |t' — t"\ and we 
may rewrite the above relation as an integral over the velocity-velocity correlation function 




(166) 







Cvv = (v(r)v(O)): 




(167) 
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Assuming a sufSciently fast decaying Cvv{t) so that the integral over r converges for t oo 
we may or large times t replace the upper limit of the integration by infinity which yields: 



{Ar\t))=2 



drCvv (t) 



(168) 



Thus we define the diffusion coefficient according to the Taylor-Kubo formula in arbitrary 
spatial dimensions d as: 

oo 

i'cff = ^y"rfr(v(T)v(0)). (169) 



Note that the pre-factor with d being the spatial dimension was chosen in analogy to ordinary 
Brownian diffusion (Eq. (|8])), and may differ from other definitions of the (effective) diffusion 
coefficient. All of the outlined formulas can be generalized to the case with a finite mean speed. 
The diffusion coefficient then describes the diffusive spread around the mean motion: 



oo 



= ^ ^'^\t'^'^'^^' = ^ I ^-[(-(O)v(r)) - (v)^]. (170) 

There exists a simple yet rather useful reformulation of this formula. Using the variance (^v^) 
and one particular definition of a velocity correlation time, namely the integral over the nor- 
malized auto correlation function, we can write 

D., = i^^^ (171) 

So, the diffusion coefficient depends not only on the variance of the velocity fluctuations but 
also on their typical duration which is characterized by the correlation time. We stress that this 
interpretation holds only for non-oscillatory correlation functions. 

For the cases studied in the following, the velocity correlation function is generally not known 
because of the nonlinearities introduced by the friction function. In one spatial dimension, 
however, one can solve for the integral of the correlation function over the entire time interval 
(0, oo) and in this way obtain an analytical expression for the diffusion coefficient. This can 
be achieved not only for the dynamics of active Brownian particles with white noise but also 
for a nonlinear velocity dynamics driven by a specific correlated (colored) fluctuations, namely, 
the dichotomous noise. In higher spatial dimensions, approximations for the calculation of 
the diffusion coefficient may be employed which exploit the specific symmetries of the speed- 
dependent friction (phase dynamics in 2d and 3d, scaling behavior for friction functions obeying 
a power law). 

In the following, we review the diffusive behavior of active particles with different friction 
functions, under the influence of asymmetries, and driven by white or colored noise. A par- 
ticularly simple kind of nonlinear friction functions, namely those given by a power law, is 
treated separately because it makes certain limit cases for the diffusion of active particles more 
comprehensible. We then proceed with new features occurring in the diffusion in higher spatial 
dimensions. 



4.2 Diffusion in one dimension 

4.2.1 Diffusion for a symmetric friction function and white noise 

Let us first consider 7(— w) = j{v) and a driving by a white Gaussian noise. In this spatially 
symmetric case we obtain a vanishing stationary mean velocity 

{v) = (172) 
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and the diffusion coefficient is the remaining statistics of interest. We mention that different 
approximations for the diffusion coefficient have been suggested for the one-dimensional case 
[531 64 94 2134; the derivation of the exact solution will be shown in the following. 

Useful for the calculation of the diffusion coefficient is the introduction of a velocity potential 
given by 



dv'^{v')v' . 



(173) 



For a typical friction function of an active particle, this potential is bistable and thus has 
two metastable states with finite speed whereas the zero velocity is dynamically unstable. 
Specifically, for the Rayleigh-Hclmholtz friction function introduced in Eq. I^^ . the potential 
reads 

^{v)=fi-~a-- (174) 



in this section, we set a = /3 
obtains the potential 



4 2 ' 

1. For the friction function of the depot model in Eq. ([5 



— ln(l + w2rf/c) 
70 



In the following, we use the numerical values 70 ~ 20, d/c = 40, q = 5. 
The Fokker-Planck equation for the velocity process reads 

dtP{v,t) ^ d,{^' [v) + Dd,\P(v,t). 



(175) 



(176) 



We recall j287| that (i) this equation can be easily solved in the stationary state, yielding a 
Boltzmann-like distribution Pq ~ exp[— <?(f )/D]; (ii) the transition probability P(i;, tj'yo, 0) is 
governed by the EPF with the initial condition P(?;,0) = (5(w — wo); (iii) there is no general 
solution for Pi^v^ t|wo: 0) for a general nonlinear force —^'(v). If we would know P(w, t|uo, 0) we 
could calculate the velocity correlation function by 



v(t)v{^)) = dv dvavvoP{v,t\vo,0)PoM 



(177) 



where the last two factors express the joint probability density P{v, t] vq, 0) by means of Bayes' 
theorem. Inserting the correlation function into the Green-Kubo formula, we may write 



dvv dt dvoVoP{v,t\vo,0)Po{vn) 



dvvG{v) 



(178) 



An ordinary differential equation for G{v) can be obtained from the Fokker-Planck Eq. (|176p 
by integrating over time, multiplying with the known stationary probability density in uq; a-nd 
integrating over the latter variable. The resulting equation reads: 

- vPq{v) = {<P' {v)G{v))' + DG"{v) (179) 

which can be solved in terms of quadratures. After a few simplifications (using also the symmetry 
of the potential), the result for the diffusion coefficient reads j214j 



eff 



00 


00 
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/ dv2 e*("=)/^ 


/ dvi e-*("i)/^wi 







"2 





£12 / df3 e-fM/D 





(180) 



We note that the same techniques has been used by Jung and Risken [179j and in particular by 
Risken in the second edition of his well-known textbook [287] to obtain an analytical expression 
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for the correlation time of a stochastic process governed by a nonlinear Langevin equation (the 
connection to Tcorr is evident in ll7ip . 

Before coming to the case of active Brownian motion, let us first consider a simpler nonlinear 
speed-dependence of the friction which is given by a power law. In particular, we assume that 

j{v) =-fov^°',a>0. (181) 

(note that a has nothing to do with the parameter of the RH friction function, which we set to 
zero). This problem has been studied in detail in Ref. |215| where it has been shown that the 
diffusion coefficient in this case scales like a power law with the system's parameters: 

D^ff ^j^^DT^ (182) 

This result can be obtained from the exact expression by changing the integration variables 
appropriately (the factor of proportionality is then given by an integral that still depends 
on a but not on D or 70 anymore). It can be, however, also obtained by renormalization of 
the original Langevin equation (see |214| ) a techniques by means of which one can show that 
Eq. (jl82p holds also true in arbitrary dimensions although of course with different pre-factor 
than in the one-dimensional case. 

On closer inspection, Eq. (|182p is a little surprising. It tells us, for instance, that for a pure 
cubic friction {a ~ 1), the diffusion coefficient does not depend on the noise intensity D at all. 
Furthermore, for stronger than cubic friction (a > 1), the diffusion coefficient decreases mono- 
tonically with increasing D and diverges in the limit of vanishing noise intensity. In the case 
of normal Brownian motion (a ~ 0), the diffusion coefficient is proportional to the noise inten- 
sity as expected. All of these conclusions are illustrated and confirmed by results of numerical 
simulations in Fig. [M] 
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Fig. 24. Diffusion coefficient vs noise intensity D for the one-dimensional case (7 — 1) and various 
values of the exponent. Theory (numerical evaluation of Eq. (|180|l ) is compared to simulation results. 
Modified from \215\. 



In order to explain this behavior we have to recall that according to Eq. (jl7ip the diffusion 
coefficient is given by the product of the variance and the correlation time of the velocity 
fluctuations. Increasing the noise intensity will in all considered cases increase the variance. 
The effect on the correlation time, however, is more complicated. For strong noise and a strong 
nonlinear friction {a > 1), the velocity attains typically large values at which the dissipation 
term ti^^+i [g stronger than in the linear case, hence the correlation time is shorter and becomes 
even shorter for further increasing noise. In the opposite limit of vanishing noise, the velocity is 
typically at values close to zero where the dissipation term is now much weaker than in the case 
of normal Brownian motion. For a cubic friction the tendency of increasing velocity variance and 
decreasing correlation time balance exactly and their product remains constant upon variations 
of D. For a stronger friction, the sensitivity of the correlation time with respect to changes in 
the noise is even stronger and dominates the dependence of the diffusion coefficient on D. 
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Let us now turn to the case of an active Brownian particle. First wc consider the depen- 
dence of the diffusion coefficient for the depot model introduced in Sec. 13.1.31 In this case the 
quadrature formula has been evaluated numerically and the result is shown in Fig. [55] 
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Fig. 25. Diffusion coefficient vs noise intensity D (a) and velocity potential (b) for the friction function 
of the depot model. In (a), theory (numerical evaluation of Eq. (|180|l with the potential Eq. (|175|l 
is compared to simulation results. The inset in (b) illustrates that the velocity potential behaves 
asymptotically as a parabola <P{v) ~ (dashed line). Modified from |214) . 



We observe a nonmonotonic relation between the diffusion coefficient and the noise level: 
the diffusion is minimized at an intermediate noise level. We can understand the growth with D 
seen at large noise intensity because at large values of the velocity (typically attained at strong 
noise) the depot model approaches the Stokes limit of a speed-independent friction coefficient. 
At the level of the velocity potential this implies a parabolic potential at large speed (cf. 
Fig. [25b). In the opposite limit of weak noise the bistability of the velocity potential becomes 
essential. Here the velocity undergoes noise-induced transitions between the two metastable 
states corresponding to the minima of the potential. For such a process, the diffusion coefficient 
is inversely proportional to the Kramers hopping rate |231l94j 

D., « , exp[4^] = ^ (183) 

The latter relation agrees with Eq. ([5T|) for A± = r^, \v± \ ~ vq; it has been derived for a velocity 
following a telegraph process with rate rfc in [296] • Assuming weak noise D, Eq. (|183p can be 
also derived via a saddle-point approximation from the exact result Eq. (jl80p . 

The divergence of the diffusion coefficient can be understood by considering the spread of 
an ensemble of active Brownian particles. At equilibrium half of the particles are in the left 
well with a corresponding finite speed going to the left while the other half is situated in the 
right well and thus go with finite speed to the right. Without any transitions between the 
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wells (a limit that is approached for vanishing noise), the growth of the m.s.d. would occur 
ballistically. Incidentally, this has to be taken into account when choosing a simulation time for 
an estimation of the diffusion coefficient. One has to wait at least a multiple of the correlation 
time of the process, in order to see a diffusive growth of the m.s.d. Very similar to the case 
of normal Brownian motion, there is a ballistic phase in the m.s.d. time course. The time of 
this growth can be estimated from the relation between diffusion coefficient, variance, and 
correlation time Eq. (jl71l) : Tcorr — D^s/ {Av^). because in our numerical example (Z\u^) ~ 1 
but Doff is exponentially large, the correlation time is rather large. In order to get reasonable 
estimates for the diffusion coefficient, an ensemble of trajectories has to be simulated at least 
for a multiple of this large correlation time. 
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Fig. 26. Diffusion coefficient vs noise intensity D (a) and velocity potential (b) for the RH model. In 
(a), theory (numerical evaluation of Eq. (|180|l with the potential Eq. (|174p ') is compared to simulation 
results. The inset in (b) shows the asymptotic behavior of the potential which is dominated for the RH 
model by the quartic term ${v) ~ v"^ (dashed line). Modified from |219) . 



Turning back to the minimum, which we observed for the diffusion coefficient vs noise 
intensity: is such a minimum observed for all possible friction functions of active Brownian 
particles? The results on the power-law friction function tell us otherwise. If a friction function 
has a nonlinear asymptotic limit such that the friction increases like a power equal or stronger 
than cubic friction, the diffusion coefficient will either saturate (for cubic friction ^(v)v ^ w^) or 
even decrease (for friction stronger increasing than 7 ~ u^) in the asymptotic limit of large noise 
D. So in these cases we cannot expect to observe a minimum. Indeed for the RH model which 
is at large speed dominated by the cubic term, the diffusion coefficient decreases monotonically 
with the noise intensity D. We note that the divergence of the diffusion coefficient in the limit 
D — >■ is untouched by the asymptotics of the velocity potential because this divergence hinges 
solely upon the presence of a potential barrier. 
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4.2.2 Diffusion in the spatially symmetric case with colored noise 

The assumptions wc make on the phenomenological model of an active particle are often based 
on simplicity. One such assumption is the lack of correlations in the driving noise process 
^(t). After we have reached some understanding of the active Brownian motion dynamics in 
one dimension with white noise, we may relax this condition and consider the case where the 
fluctuations have a finite correlation time, i.e. we consider 

^x = v, = --f{v)v + 7j{t) (184) 
where r](t) is a colored noise that we choose here to have an exponential correlation function 

mv{0)) = <j'e-'''. (185) 

There are two simple stochastic processes with such a correlation function but different proba- 
bility density. The first one is the symmetric dichotomous process (DMP, also called telegraph 
noise) which jumps between two values —a and a with transition rates A. The other one is a 
Gaussian noise, the Ornstein-Uhlenbeck process (OUP) rj, which can be obtained by integrating 
the stochastic differential equation 

^77 = -2XTj(t) + 2aVX^{t) (186) 

{£,{t) is as usual white Gaussian noise with (C(^)C(i')) = ^(^ ^ t'))- The unusual scaling in the 
OUP ensures that variance and correlation time are the same for OUP and DMP in terms of 
the parameters (cr. A) . 

If the driving noise introduces a finite correlation time, one question of interest is how this 
time scale affects the diffusion coefficient. The DMP offers a simple case in which this question 
can be explored analytically. By a very similar approach as discussed above for the white-noise 



case, one can derive an exact quadrature formula for the diffusion coefficient [216j . 

For the velocity process driven by a dichotomous noise, we may write down evolution equa- 
tions for the probability densities P+{v) and P-{v) that the velocity attains the value v and 
that the noise is at = cr and 77 = — cr, respectively: 

dtP+ = d4'y{v)v - a]P+ - AP+ + AP_ (187) 
dtP- = dy[-/{v)v + cr]P_ + AP+ - AP_ (188) 

These two equations solved for different initial conditions with respect to the noise would yield 
four transition probabilities p±,±{v,t) (p+._ (w, <|t;o), for instance, is the probability to find the 
velocity at v and the noise at 77 = cr if initially at t = the velocity was at vq and the noise 
was r]{0) = —a) by means of which the velocity correlation function can expressed: 



vit)vit + T))= J dvv j dvoVo{iP+++P-+)Pl + {P+-+P—)P^} 



(189) 



We can use again the fact that for the diffusion coefficient we have to know only the integral 
over the correlation function. By integrating Eqs. (jl87[) we obtain a system of ordinary differ- 
ential equations for two auxiliary functions (comparable to the function G{v) in the previous 
subsection), the integral of which then yields the diffusion coefficient. Further details on the 



lengthy but straightforward calculation can be found in |216j : the final result reads 

I?cff = 2\cj^^, 1>{v) = -2A / V^^. (190) 



. I - V-/ / 2 _ f2(rr.\ 

J d2e-*W[fT2-/2(z)]-l i ^ 
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The value of Vm is set by the maximal speed by which the particle can go under dichotomous 
driving and is found from the equation 'y{vm)vm = c. 

In the white-noise limit of the dichotomous fluctuations A — > oo, ct — > oo with D = cr^/ (2A) = 
const, the expression approaches the result Eq. (|180p . Further limit cases as well as the numerical 
evaluation of the integrals is discussed in |216| . Here we review the dependence of the diffusion 
coefHcient on the new time scale in the problem given by the switching rate of the DMP. 




Fig. 27. Diffusion coefficient vs switching rate of the telegraph noise for a cubic (a) and a quintic 
friction function (b) for different amplitudes of the driving as indicated. Theory (solid lines, Eq. (|190|l ') 
is compared to simulation results. Modified from [216] . 



Let us first consider the simple case of a power law friction. The diffusion coefficient for 
a cubic friction decreases monotonically with increasing switching rate. We can understand 
the limits of small and large rate based on the results from the previous subsection. At small 
switching rate the velocity process relaxes towards the asymptotic value ±Vm - the dichotomous 
character of the input process carries over to the velocity with an amplitude which is determined 
by the nonlinear equation for Vm- We mentioned already that for a velocity following a telegraph 
noise, the diffusion coefficient is proportional to the inverse of the switching rate and this is 
exactly the behavior observed in Fig. [27] in the limit A — >■ 0. In the opposite limit of a large 
rate, the DMP approaches white noise with a vanishing intensity because D = (t^/(2A) (ct is 
constant). For a cubic friction, however, the diffusion coefficient does not depend on the noise 
intensity and thus D^g approaches the constant value that we already obtained in the white 
noise case for ■y{v)v = jqv^ (cf. in Fig. [24]the data for a — 1). 

For a friction function with stronger nonlinearity, for instance, for a quintic dependence on 
V, the divergence at small rate remains the same (also here we observe a dichotomous velocity 
process dictated by the slow driving), at strong rates, however, the diffusion coefficient also 
diverges in marked contrast to the cubic case (Fig. [?7b). The reason for the increase at large 
rate is also quite plausible. With increasing rate the white-noise limit is approached with a noise 
intensity that decreases with rate. We saw before that for a friction function with a > 1 the 
diffusion coefficient diverges for vanishing noise and it is exactly this divergence that we now 
observe for increasing rate. As a consequence of asymptotic behavior, the diffusion coefficient 
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attains a minimal value at intermediate rate. The rate for the minimal diffusion coefficient 
depends on the amplitude and is approximately given by |216] 

A™„ « 2{A^^f'\ (191) 




Fig. 28. Diffusion coefficient vs DMP switching rate a Rayleigh-Helmholtz friction function; amplitude 
of the driving is cr = 1.875. Theory (solid line, Eq. 1)190 1) ) is compared to simulation results. Modified 
from pT6] . 

For an active Brownian particle we also find a minimum in the diffusion coefficient vs rate 
(Fig. [^5]) because in this case we recover in the limit of large rate the weak-noise limit of 
the white-noise case associated with a bidirectional motion with rare reversals. Hence, here in 
both limits of small and large switching rate of the telegraph noise we observe a bidirectional 
motion although for two different physical reasons. We note that for the Rayleigh-Helmholtz 
friction function used in (Fig. [28)) . our theory is constraint to the condition of a sufficiently 
large amplitude ensuring that transitions between the metastable states are possible at all. 

One may wonder how much the above results hinge upon the discrete support of the tele- 
graph noise. Surprisingly, for all the cases discussed above it docs not make much of a difference 
if we replace the colored dichotomous noise by a colored Gaussian noise, i.e. by the Ornstein- 
Uhlenbeck process. In this case, simulations reveal a minimum in the diffusion coefficient for 
a quintic friction function (Fig. ^^j^) and also for a for a Rayleigh-Helmoltz friction of an ac- 
tive particle (Fig. WSh). Even a naive comparison of the OUP simulations to the theory for 
dichotomous driving shows a rather good agreement (cf. solid lines in Fig. [^^ . At least for 
a sufficient amplitude of the driving, the variance and the correlation function of the driving 
noise (statistical features shared by DMP and OUP) seem to be essential in determining the 
diffusion coefficient and the exact distribution of their values (a feature that distinguishes DMP 
and OUP) is immaterial. 

4.2.3 Particles with asymmetric friction function under white-noise driving: critical asymmetry 

So far we have considered symmetric friction functions and symmetric noise sources for which 
the mean velocity vanishes. A perfectly symmetric friction function is not expected in the 
dynamics of active particles. Assemblies of molecular motors interact with filaments of a certain 
polarity; if the assemblies are described by an active Brownian particle dynamics then this 
dynamics will not be symmetric (7(— f ) 7^ 

A simple way to introduce an asymmetry is an external bias. Thus we may consider the 
Langevin dynamics 

= V, = -j{v)v + F + V2D^{t) (192) 
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Fig. 29. Diffusion coefficient vs switching rate of the Ornstein-Uhienbecfc noise for a quintic (a) and 
a Rayleigh-Helmholtz friction function (b). The theory for the dichotomous process witli tlie same 
variance and rate (solid lines, Eq. (|190|l ') is shown for comparison. Modified from |216| . 



We can lump both nonlinear friction ("pumping") force and the external bias into the derivative 
of one effective velocity potential. This potential is not symmetric anymore but tilted and for a 
sufficiently strong force even its bistability will be lost (sec Fig. [50]) . In terms of this potential 
it is very clear that the asymmetry will have a profound effect on the diffusive properties of 
the particle. The strong diffusion we observed in the symmetric case and at weak noise relies 
on the bimodality of the velocity which will, however, vanish if the velocity potential is not 
bistable anymore. Thus we can expect that the diffusion coefficient becomes very small in the 
limit of strong force whereas it diverges for finite but small forces. It is, however, not clear what 
the exact value of the force is where the divergence of the diffusion coefficient vanishes. One 
first guess would be the force at which the potential loses its bistability. A closer inspection, 
however, disproves this conjecture. 

First, we can repeat the previous calculation for the calculation of the diffusion coefficient 
based on the Fokker-Planck equation (see the related calculation for the correlation time in 
supplement S.9 in 12871 ). The more general result for the diffusion coefficient reads j218j 



^"""^ D r dv e-*(")/^ 

J — OO 



(193) 



Here (p{x) is the new effective potential which includes the bias. For weak noise and a bistable 
potential we can perform a saddle-point approximation of this result and obtain a much simpler 
formula. The latter can be alternatively derived by a two-state theory that yields a better 
physical insight. 

In the asymmetric case, the motion of the velocity in the bistable potential is governed by 
two Kramers rates r± for the escape over the larger (smaller) barrier and the velocity obeys 
the statistics of a dichotomous noise. Correlation time and variance the product of which forms 
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Fig. 30. Quartic velocity potentials ${v) = v* /2 — Fv (upper row) and the corresponding velocity 
probability densities P{v) ~ exp[~<l>{v) / D] (lower row) for three different values of the external force 
F as indicated and a noise intensity of D = 0.1. 




Fig. 31. Symmetric (dotted line) and asymmetric (solid line) potentials with potential barriers indi- 
cated. 



the diffusion coefficient arc given by jl30 



(r+ +r_)2 



(194) 



in accordance with Eq. ([5T|). We are specifically interested in the limit of vanishing noise 
intensity for which both rates go to zero. In the general asymmetric case, the rates dif- 
fer by an exponential pre-factor given by the difference between the two potential barriers, 
r+/r_ ^ exp[— — A<P-)/D] and, hence, the correlation time diverges but the variance 
vanishes. The latter finding implies that in the limit of vanishing noise the particles dwells 
with probability one within the deeper well. Because the diffusion coefficient is the product 
of variance and correlation time, it is not clear at all when the divergence of the correlation 
time and when the vanishing of the variance dominates the diffusion coefficient. Inserting the 
Kramers formula into the product one obtains the specific formula 



27r(t>_|_ — V-)ujj^.uj-/\uJo\ 



-(2Zi<i'_-A<f+)/(3D), 



-(2zl*+-ZiS>_)/(3r>)13 ' 



(195) 



which is also obtained by a saddle-point approximation of the exact result Eq. (jl93p . Here, 
uj± are the curvatures in the extrema of the potential. This approximation is valid in the limit 
of weak noise and yields the most interesting result in the thermodynamic limit of vanishing 
noise (D 0) that we explore now. Let us assume without loss of generality that Z\<?+ is the 
larger barrier. Then the second exponential in the denominator of Eq. (|195|) will vanish rapidly 
for D ^ 0. The first exponential, however, can either go to infinity (resulting in a vanishing 
diffusion coefficient) or to zero (yielding a divergence in the diffusion coefficient) depending on 
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the sign of the exponent 2A<P^ — In the case of a mild asymmetry, the larger barrier Z\<?+ 

will be still smaller than the double of the smaller barrier — in this case the diffusion 

coefficient diverges as in the symmetric case. A stronger asymmetry, which does not destroy 
the potential's bistability but makes the larger barrier greater than the double of the smaller 
barrier, leads to a positive exponent and thus makes the diffusion coefficient vanish in the limit 
of zero noise. The critical force by which these two distinct diffusive behaviors are separated is 
clearly determined by the condition 

A4>+{F„it) = 2A<P^{F,,it) (196) 
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Fig. 32. Mean velocity (top) and effective diffusion coefficient (bottom) vs external bias for three 
different noise intensities as indicated. Color lines give the theory from Eq. (|193|l while black dotted 
lines is the weak-noise approximation from Eq. (|195|l . Modified from [218j . 

The critical force (and its symmetric counter part — Fcrit) form the boundary of a region of 
giant diffusion (shaded region in Fig. [32b). Generally, no transition is seen in the mean velocity 
(shown in Fig. 132b .). Hence if for strong asymmetry the mean velocity is finite, we are entitled 
to talk about a parameter region of regular transport (outside the shaded region in Fig. I32p . In 
Fig.[32]the comparison between the full numerical evaluation of the exact solution Eq. (jl93p and 
the weak-noise expansion Eq. (|195p reveals good agreement in the region of foremost interest 
where both potential barriers still exist but can also significantly differ. 

Note that we have not used in our arguments above that F is an additive bias. Thus 
all conclusions regarding the critical asymmetry apply also to the case where the asymmetry 
controls the barrier heights in a more complicated way; also we may generalize the line of 
reasoning to the case of an active Brownian particles with multiplicative noise. In all cases we 
will have a behavior of the diffusion coefficient similar to this shown in Fig. 1321 There is a 
finite region of weak asymmetry, for which the diffusion coefficient diverges in the limit Z? — )■ 
whereas outside this region the same limit yields a small or vanishing diffusion coefficient. 

In Sec. 13.1.61 we gave some evidence that the active Brownian dynamics can reproduce the 
bidirectional motion of coupled molecular motors. Does this imply that for coupled molecular 
motors a similar critical asymmetry as found above exists? This question was studied in |218j 
and the result of extensive simulations is shown in Fig.[23]for a symmetric (a,b) or an asymmetric 
(c,d) motor-filament interaction. 

For the motor system noise intensity is set by the inverse number of motors. Indeed, just as 
in the case of active Brownian particles, diffusion curves for different motor numbers (different 
noise levels) intersect at critical values of the external force. These values are the boundaries 
for the forcing region of giant diffusion. If the unbiased system is spatially symmetric as in 
Fig. [55k. b. the dependence of mean velocity and diffusion coefficient on F resemble strongly 
the results for the Brownian motion with Rayleigh-Helmholtz friction. Please note that the 
latter is also spatially symmetric and that any asymmetry in the system is due to the bias force 
F . If the system, however, shows a spatial asymmetry (a = 0.4 for the piecewise-linear ratchet 
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Fig. 33. Mean velocity (a, c) and diffusion coefHcient (b, d) of assemblies of molecular motors as 
a function of the external force, (a) and (c) are for a symmetric motor-filament interaction (see the 
spatial potential sketched above panels) with a — 0.5; (b) and (d) are for the asymmetric case with 
a = 0.4. Results for various numbers of motors as indicated. Modified from |218| . 

potential as shown in Fig. [55]) . both statistics arc shifted. At zero force, there is aheady a finite 
mean velocity and the motion is rather regular because the diffusion coefficient is small. Biasing 
the motor assembly against its preferred (ratchet-induced) direction, however, results for a finite 
rage of forces again in a giant diffusion. Roughly speaking, the two kinds of asymmetries add 
up and maximal diffusion is achieved if the system is rather symmetric, i.e. both directions of 
motion are roughly equal. Further support for the similarity of the underlying mechanism for 
the critical asymmetry observed for active Brownian particles and for coupled molecular motors 
comes from a measure based on the velocity's probability density which can be derived from 
Eq. UMl); for details, see piB] . 



4.3 DifFusion in two dimensions 

4.3.1 Two dimensional random walk with correlated turning angle 

Starting from this paragraph we consider diffusion of active particles in two dimensions. The 
central aim remains the calculation of the diffusion coefficient including correlations in motion, 
respectively, if he trajectories of the particles exhibit some persistence. 

We will start with a discrete random walker in two dimensions which jumps with a fixed step 
length Iq. It could be modeled by a shot noise where the sequence of (5-pcaks is supplied with 
constant weight Iq . As in Eq. (jl2p , we restrict in the consideration to an overdamped situation. 
The equation of motion reads. 

d 

i 

This (5-kicks change the position vector by Iq pointing in the direction of the unit vector e^,. . 
The ti are generated due to the waiting time density between to strokes w(t). The mean of 
this shot noise is obviously 1/ < r > where < r > is the mean time between two spikes. For 
simplicity, the occurring jumps shall be also clocked with a given time dispersionless interval 
To |182I247| . i.e. w{t) = 6{t ~ tq). 

The mean speed is obviously s = vq — Iq/{t) > 0. The unit vector of the direction is 
determined by its angle respective to the x-axis which we again label by fit). We assume that 
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the two angles between two subsequent steps i and i + 1 are not independent. The angle of 
the velocity vector are shifted by a turning angle rji for which we assume a given turning angle 
distribution P{ri). The existence of a structured distribution P{t]) different from a uniform one 
creates some persistence in the motion. We will assume that the correlations are weak and that 
they extend over one step, only. It implies that the sequence of turning angels ryi, 772, . . . , ?7i, . . . 
shall be independent. 

This situation was considered by Kareiva and Shigesada and is discussed in detail in the 
monograph by Okubo and Levin [1821247] . Than the ith displacement vector can be given by: 

Ar^ = Iq [e^ cos ipi + eySinipi) , ipi = tp^^i + r]i (198) 

where ipi is the angle between the x- axis and the direction of motion. After n ^ [t/To] steps 
the walker has a squared distance from the point of start of: 

n n 

r^, = ^zir,.^Z\r, (199) 

Averaging over an ensemble of walkers and expanding the sum yields: 

n n— 1 n 

(r^)=^(Z\r^)+2^^(Z\r, .Z\r,) 

n— 1 n 
i—1 j>i 



The second term on the r.h.s requires a distribution of the turning angles P{r]) which we 
assume to be symmetric in Then the mean squared displacement is expressed by the angular 
correlation defined as the average F of the cosine of the turning angle 

TT 

r = (cos?7) = J d77 COS 77 P(77) (201) 

This expression has the physical meaning of how much on average the length of the unit vector 
By is reduced if projected on the direction of the previous jump. Since correlations have been 
considered only between successive steps we get for two jumps 

TT TT 

(cos((/., - ^,+2)) = / dr;P(?7) / dr;' P{7^') cos(77 + 77') = P^ , (202) 



It can be shown as well with k > 2 that 

(cos((^, - (^,+fc)) = P'' . (203) 



So we can solve the sum in (j200p and get a formula for the mean squared displacement after n 
steps of a 2D correlated random walk like in |247| and |168j , which was derived previously by 
Kareiva and Shigesada |182j : 

(rl) - ll ( 2r-i-^^ cx ( nl±^ ■ (204) 




i-p {i-py 



if n — > CX) since \r\ < 1. In this limit the second term on the right hand side of (j204p becomes 
time independent for large n. 
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Therefore the diffusion for short times anomalous at at long times is normal with coefficient 

i^off = ^ . (205) 

i~ r 4 To 

The second term in the sum can be interpreted as the square of a characteristic length scale, 
ff this length scale is much smaller than the length scale of the process itself, normal diffusion 
approximation holds. 

As can be seen from Eq. (|20ip F vanishes if rj is equally distributed. This corresponds to 
the motion of a freely diffusing particle without any directional correlations between the jumps. 
We see also that a persistence of the trajectory with F larger than zero enhances diffusion. An 
negative sign of the correlation parameter decreases the diffusion coefficient. 

We will also have a look at the diffusion coefficient without correlations F = 0. One can 
replace the jump length by the duration of the jump and the velocity, i.e. Iq ~ vqTq. Afterwards 
we set To equal to the relaxation time for the angular fluctuations from Eq. (|67p . i.e. tq = = 
D/vq. Put together we obtain that the effective diffusion coefficients behaves as ^ v^/D as we 
will find several times from the continuous theory of Active Brownian particles, later on |231j . 
It means, surprisingly, that increasing noise decreases the value of the diffusion coefficient. 

An application to particular situation of a hopping Daphnia motion was given in |195ll28j . 
Therein specific angle distribution, like exponential and bimodal ones have been assumed in 
order to control the diffusion coefficient. 

One has to add that the same way of calculation of the diffusion coefficient was used by 
R. Fiirth |126| who considered persistent random walk in one dimension. He assumed the 
probabilities p and I — p that the particles jumps after to the length Iq preferentially in the 
same direction or in the opposite one, respectively. Such way he formulated correlations between 
successive hops. In consequence, one can also find the probabilities for all longer sequences of 
possible jumps and also the correlations between over next hops arc included. If summing up 
the all jumps in (|200p one determines the mean squared displacement in one dimension. 

One limit is the case with p = 1/2, i.e. no preference in the angle is assumed and the 
diffusional motion is free and he diffusion coefficient equals Iq/{2tq). In contrast in the limit 
p — 1 and To — >■ with (l—p) /tq = 7/2 = const the diffusion coefficient of a Brownian particles 
with inertia and m = 1 likewise in ([7]) is obtained. The correlation time Tcorr = 1/7 quantifies 
the persistence length Ipers = wqt with assumed fixed velocity vq ~ Iq/tq- 



4.3.2 Diffusion for independent velocity and heading dynamics 

In higher dimensions, the diffusion of active Brownian particles becomes more complicated and 
is only in a few cases analytically tractable. A popular and reasonable approximation in this 
case is the assumption that velocity and direction of motion are independent variables; this will 
be presented here, following the work by Peruani and Morelli |268] . 

In general the motion of an active Brownian particle in arbitrary dimensions d can be 
described by its a unit vector describing the direction of motion (heading) eji{t) at time t and 
the velocity with respect to the heading direction (see Sec. 12. 3|) . 

In two spatial dimensions, with e/i(t) = (sin(0(i), cos 0(t)), assuming completely indepen- 
dent dynamics in v and (heading angle) the evolution of the velocity vector v = v{t)eh{t) is 
determined by the following stochastic differential equations: 

i, = -^(^v)v + ij^{t) (206) 

^ = V4>it)- (207) 

The first term in the velocity equation is again an arbitrary velocity dependent friction function 
which describes the deterministic evolution of the velocity. The second term is the stochastic 
part with rjy being the component of random force acting on the velocity. The evolution of 
the heading angle is assumed to consist only of a stochastic torque acting on cj). In (|207p . it is 
assumed that the angular velocity (or turning rate) does not dependent on the velocity v, and 
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wc should note that it is in general not the case, in particular, if we consider turning behavior 
with inertia. 

In general the fluctuations riy_^{t) can obey arbitrary distributions and temporal statistics. 
Here, we consider independent and uncorrclated Gaussian (white) noise terms, based on our 
ansatz for active fluctuations (Sec. [ 



77, = V^^v, = V^U^ (208) 

which is, based on the center limit theorem, a reasonable approximation of many random 
processes occurring in nature. 

For independent v and 0-dynamics the joint probability distribution my be decomposed as 
P{v,(p,t) = Py{v,t)Pcf,{(t),t). Thus the expectation value for the displacement (r(t)) reads 

t t 
(r(t)) = / dt'{v{t')en{t')) - / dt' {v{t')){en{t')) (209) 



In the absence of a preferred direction of motion (uniform distribution of 0) , the time average 
and ensemble average with respect to e^, vanishes and so does the mean displacement (r(<)) = 0. 

The mean square displacement (r^)(i) in the absence of directional bias can be obtained 
according to Eq. (jl66p from the velocity- velocity correlation function. Here G^^{t) decomposes 
into independent vv and e/ie/i-corrclation functions: 

t t' t t' 

(r2(i)) = fdt' f dr(v(0)v(T)) ^ fdt' f dr{viO)v{r)){eh{0)ehiT)) (210) 



00 00 

Assuming an exponential decay of the velocity correlations we may rewrite the velocity corre- 
lations in the stationary case as 

{v{0)v{t)) = (w2)e--"- + («)2(i _ e-«"-) (211) 

with (v) and (u^) being the first and second moment of the stationary velocity distribution 
Ps{v) and K,y being the relaxation rate (inverse relaxation time). 

The angular dynamics in Eq. (|207p results in a free diffusive motion of e/i on a unit circle, 
with an exponential decay of autocorrelations: 

(eft(0)e,,(r)) = 6"'^''^ (212) 

with Kh being the correlation decay rate of the direction of motion. In the case of free diffusion 
of (j) it is equal to the angular diffusion coefficient: = Dff,. 

Inserting Eqs. (PTT|) and ipH)) in Eq. (PTUl) yields finally P55] : 



t+ — (e-'"^' - 1) 



Ky -\- Kfi 



t + ^ f e-('^"+«'')* - 1) 

K„ + Kh ^ ' 



(213) 



The first term describes the contribution of the mean square displacement due to self-propelled 
motion with (constant) mean velocity (w) and a stochastic direction of motion, whereas the 
second term takes into account the impact of velocity fluctuations on the mean square displace- 
ment. 

For particles moving with constant speed ((u) ~ vq = const.) there exist two different 
scaling regimes of (r^(i)) with t similar to ordinary Brownian motion: The so-called ballistic 
regime at short times with {r'^{t)) oc t'^ and the diffusive regime with {r'^{t)) cx i for t — )• 00. 
Between the two regimes there is a crossover at time t ^ kJ^ . 



Will be inserted by the editor 



69 



The introduction of an additional timc-scalc due to velocity fluctuations may lead to a 
mean square displacement with four distinct regimes and three crossovers in between. For large 
time scale separation: (k/j + ^ the angular correlation decays much slower than 

the velocity correlations [nh/nv ^ !)• Thus starting from its initial position at t = the 
particle performs first a quasi one-dimensional motion along its initial direction of motion. The 
stochastic decorrelation of the velocity in this effective one-dimensional motion leads to a first 
crossover from ballistic to diffusive motion. After the velocity dynamics reach a stationary state, 
what matters is only the average motion with the mean velocity (u). This regime corresponds 
to a self-propelled particle with constant speed performing (still) effectively a one-dimensional 
motion with (r^) oc t^. As a consequence a second crossover can be observed from the transient 
diffusive regime to a second ballistic regime. Finally, in the limit of large times t — > oo, the slow 
decorrelation of the direction of motion leads to the third and last crossover towards the final 
diffusive regime. 

The diffusion coefficient of the limiting diffusive regime reads (Eq. I169P : 

i(W!,(i!>^V (214) 



This results, as well as Eq. (|213p . holds for arbitrary dimensions d = 1,2,3 as long as the 
heading correlations decay exponentially and are governed by a single time scale given by k^^. 

An additional bias (e.g. external force), may even introduce yet another time-scale and in 
this case even five crossovers are possible |268] . This complicated behavior of the mean squared 
displacement can be an explanation for experimental observations of superdiffusivc motion of 
active particles |365l81j : several crossovers and averaging over nonidentical active particles may 
lead to observations of mean squared displacements, which appear to be in between ballistic 
and diffusive motion. 



4.3.3 Diffusion of active particles with passive fluctuations 

In contrast to the previous section, we consider now active particles with correlated fluctuations 
in the velocity and direction of motion, due to only passive (or external) fluctuations acting 
simultaneously on both degrees of freedom as introduced in Sec. l3.3l in Eq. (jllSp with Dv,D^ = 
0. At low external noise intensities D the velocity distribution for an arbitrary friction function 
is given by a narrow peak around the stationary velocity vq and as a first approximation the 
velocity can be assumed as constant: v ~ vq = const. The external (passive) fluctuation act 
only on the direction of motion. In this limit the velocity correlation function reads 



(w(O)u(t) cos(v3(t) - v?(0))) = { cos((^(t) - ^^(O))) = v^expi ^ 



D 



(215) 



Inserting Eq. (|215p in Eq. (|213p gives us the mean square displacement: 



{Ar'it))=2^ 



i+|(cxp{-§t}-l 



(216) 



This is a well known result obtained previously by Meinkohn and Mikhailov |231] . 

The corresponding long time effective spatial diffusion coefficient is inversely proportional 
to D and reads 



-Dmm = hm 



(APit)) «4 



it 



2D' 



Please note the different power-law dependence of Dmm on vq 
vanishing velocity fluctuations {{v'^) — {v 
motion with inertia is considered. 



(217) 

') in comparison to (j214p for 
0) . This is due to the fact that in Eq. (|118p active 
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In general, the diffusion coefEcient of self-propelled particles (v vq ^ const.), decreases 
with increasing noise strength D in contrast to ordinary Brownian motion. In the limit D = 
the fluctuations in the direction of motion vanish and the self-propelled particles moves with 
constant velocity along its initial direction of motion. The mean squared displacement increases 
as ~ and we observe only ballistic motion - no diffusion. Thus, for D — )■ the effective diffusion 
coefficient diverges. On the other hand, with increasing D the fluctuations in the direction of 
motion increase — the particle changes its direction of motion with increasing frequency. As 
the velocity does not increase with D this leads effectively to a localization of the particle 
and decreasing diffusion. Thus, for active particles moving with a constant speed the diffusion 
coefficient vanishes -Dmm — >■ as D — > oo. 

For the linear Schienbein-Gruler model (see Sec. 13. 1.2)) the above low-noise limit corresponds 
to -D/70 <C Vq. Thus in the limit _D — > the effective diffusion coefficient will converge to Eg. 12171 



However, in the limit of large noise intensities D/70 3> Vq we may neglect the active motion 
term in the Schienbein-Gruler friction and put vq = 0. The dynamics reduces to ordinary 
Brownian motion with the effective diffusion coefficient Dbm = D/jq which increases linearly 
with D. 

Based on the two asymptotic limits it becomes evident that there must exist a minimum of 
the effective diffusion coefficient. A crude approximation for Doff can be obtained by a sum of 
the two asymptotic diffusion coefficients: 

A = Dmm + Dbm = tJt^ + 4- (218) 
2jJ 7^ 

This approximation has the right asymptotic behavior and reproduces qualitatively the behavior 
of Des at intermediate noise strengths D. But a comparison with the numerical results reveals 
that this approximation underestimates the diffusion coefficient close to the minimum. 

We attempt to improve the approximation of Dcs by considering the velocity drift term in 
the Fokker-Planck Equation (fTO]) with vq > 0. The most probable velocities v, corresponding to 
the maxima of the velocity probability distribution arc given as roots of the drift term according 
to the Stratonovich interpretation: 

-7o(w - vo) + ? = 0. (219) 

V 

By multiplying with v we obtain a quadratic equation for v with the roots: 



The positive root corresponds to the maximum at positive velocities close to vq whereas the 
negative root corresponds to the maximum at negative velocities (backwards motion). At low D 
the backwards motion may be neglected and the most probable velocity is given by the positive 
root v+ . Inserting w = in Dmm (|217p gives us qualitatively the right behavior of the diffusion 
coefficient with a minimum at intermediate D but does not reproduce the correct asymptotic 
for D — )■ 00. In order to eliminate this deviation we add a correction term D/{2jq) and obtain 
a second approximation as: 



2D 272 



Du = ^ hrr^ '- + ^- (221) 



A comparison of Du with numerical results shows that it offers a better approximation then 
the Di but overestimates the diffusion coefficient close to the minimum. 

The two approximations appear to provide a lower and an upper bound of the effective 
diffusion coefficient close to the minimum. We obtain a third approximation by taking the 
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Fig. 34. Effective diffusion coefficient of Schienbein-Gruler model with external noise versus noise 
intensity D for two different parameter sets: (a) 70 = 1.0 and uo = 1.0, (b) 70 = 10.0 and vq — 2.0. 
Comparison of numerical results with the analytical approximations Di ()218|) . Du ()221|) and Dm 
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average of Di and Du. This heuristic ansatz does not yield any additional qualitative insights 
but results in an analytical expression for Dcs with a good agreement to numerical simulation: 

D,s « All = liDi + Du) 

vf. 1 / r. 4dV 

In Fig. 131] wc show a comparison of the three analytical approximations for I?cff • Please note 
that at low noise intensities all approximations seem to yield systematically larger values of 
Deff then the numerical simulations. This can be associated with the coupling of the effective 
angular diffusion to the velocity dynamics, which have not been taken into account correctly. 



4.3.4 Turning angles as Gaussian Ornstein-Uhlenbeck process 

Another model to include correlations of the trajectories starts with equation of motion for the 
angle dynamics (See Eq.lBH). So far in case of constant speed vq and a continuous angle changes 
we widely have used that the turning angle is a Wiener process and, respectively, its angular 
velocity Gaussian white noise. The corresponding solution of the FPE is simply formulated 
from Eq. (|72p putting ]7 = or from Eq. if periodically wrapped. 

The situation without preferred turning angle (see Eq. I63p can be generalized to a corre- 
lated Ornstein-Uhlenbeck process |348l57ll62ll48j as a model of possible correlations. Some 
exemplary models of correlated dynamics are found in |297I209I305| . Here, applied to angular 
dynamics, the corresponding angular velocities have vanishing mean but possess Gaussian de- 
viations correlated over a characteristic time tc- The corresponding dynamics for the angular 
velocity is defined by the system of stochastic differential equation 

(p ^ — n{t) , n = - kH + ^j2Dn£.{t) . 
Wo 

The coefficients k, plays the role of the inverse of the correlation time tc of the angular velocity. 
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0.01 ;k=1. 
0.01; K=0.1 
Djj=0.01;k=0.01 



40 



Fig. 35. Trajectories of particles with constant speed and correlated turning angles for different values 
of correlation. Other parameters: vq — l. |359) 

Considering unwrapped angles with tp G [— oo, oo], the angular dynamics resemble the equa- 
tions of motion of a Brownian particle with Stokes friction oc k and noise intensity (compare 
Eq. ([5])). The solution of this Langevin equation is known since the seminal paper by Uhlen- 
beck and Ornstein [348] which was later generalized by Chandrasekhar to motion in a higher 
dimensional space [57]. From the time-dependent solution of the FPE, which is a Gaussian in 
the angle (p and in the angle velocity J7, we obtain, for a given initial angular velocity i?Oi the 
transition probability of the angle as j348j 



P((^2,T|(pi,r2o,0) 



2ttD{t) 



(223) 



exp 



2D{t) - K 
Therein the time dependent mean square increment of the angle reads 

D{t) = Dr2(2KT-3 + 4exp(-KT)-exp(-2KT)^ 

which exactly agrees in the unwrapped approximation with the spatial diffusion coefficient 
calculated by Langevin for the mean squared displacement ([T])- 

And thus the increment in the angle is a Gaussian distributed random variable. It simplifies 
the calculation of the mean projection along the former path according to (j215p which yields 



(cosZ\i^(r)) = exp ( — -^—^{i^t — 1 + exp(— kt))") 



(224) 



and results in the mean squared displacement of the particle 



{Ar^{t)) ^ 2vl (t-T) {cos Aip{T))d7 



(225) 



The expression with double exponentials (j224p can be evaluated either numerically in the general 
case or analytically in limiting cases |359| . We observe that it starts with a ballistic growth cx 
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and crosses over to a difFusional regime a t. One can easily veriiy that in the two temporal 
limits 

lim^((Z\r2(t)) = 2z;2r. (226) 



and 



lim -^(Zir2(i)) = 2vl f exp -^(kt-i) 
T-)-oo dr J I ^ ' 



At = const (227) 



The crossover times between both regimes depend on the coupling. Let t\ = uo-\/ n/ Dq. For 
large correlation times r = 1/k > ri the crossover time equals tcross — ti . In contrast is 
T ~ 1/k < Ti then the mean squared displacement becomes diffusional beyond tcross = k. 

An analytic tractable limit is k ^ oo with Dq = const. It corresponds to a frozen angle 
and the variance is ballistic (Z\r^(t)) = w§r^ As well one might return to the case that the 
angular velocity is white noise in the same limit k — > oo. But this time the noise intensity shall 
scale with k as Da = k^D. This case was studied previously in Section |4. 3. 3[ where the mean 
squared displacement is given by Ea. (j217p |231j . 

As shown before in Sec. 14.3.21 under the assumption of independent speed and angular 
fluctuations both contribute additively to the mean squared displacement. Assuming an energy 
pump of the Schienbein-Gruler type 



V = -7(v - vo) + 

the speed fluctuations lead to an replacement of the constant squared velocities in (|225p by the 
time dependent autocorrelation function 

A, 
7 

Parameters have been selected such, that the growth of the mean squared displacement versus 



exp ( - 7r) (228) 

he growth of the mean squared displacement versus 
time undergoes three crossovers |268j (see also Sec. 14.3.^ . The corresponding times are given 



by the relations |359 



1 Dn VnK^ 

= h^^, ^3 = ^. 229 
7 7^w5 Dn 
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t 

Fig. 37. Mean squared displacement of a particle with fluctuating speed and correlated angular veloc- 
ities [359] . 

The first time ti gives the crossing of the speed fluctuations, whereas the last one has its origin 
in the change of the angular fluctuations. At the time t2 both the value of ballistic displacement 
caused by the angular noise starts to overcome the diffusional displacement created by speed 
fluctuations. Therefore the displacement returns to a ballistic growth. 



4.3.5 Stochastic, dichotomous angular dynamics 
IVIarkovian switch between two operating orientations 

In the following, we consider again particles moving with constant speed s = vq and under 
the influence of a time-dependent torque [35111231124] . However, this time we assume that the 
rotational motion switches dichotomously between leftward and rightward turning jl95l302ll47] . 
In detail, we consider as switching protocol for f2{t) the symmetric dichotomous Markov process 
(sec Sec. 12. 4p . which is another colored noise taken as the driving torque. f2{t) may possess the 
two values ztw and switches between them with a constant rate A. The particles shall move with 
constant speed vq and, additionally, angular white Gaussian noise with intensity D^p = D/vq is 
present and perturbs the angle. 

The Langevin equation for this situation is easily formulated and reads 

^ = 12(0 + ^2^6(0, (230) 

In Fig. jSHlwe show simulations of typical trajectories where the random torque f2{t) is given 
by a symmetric dichotomous Markov process [359I360[ . as introduced in Eq. ([230p . We assume 
that the angular velocity vanishes in average, i.e. it holds (i^) = . 

We define the probability density functions for both rotational modes in analogy to Sec. 12.41 
and the description reduces to angular dynamics f{t). The particle has the joint probability 
density function P-^{ip,t\ipQ) to have the angle if and angular velocity f2{t) = +lj at time t 
conditioned by the initial value ipo att = 0. Equivalently, one defines P-{ip,t\ipo) for the state 
with f] = —Ld. Both densities obey the equations [9] 

(^, t) = ^J-^fA + _ AP, (^, t) + AP, (^, t) . (231) 
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X X 

Fig. 38. Trajectories of particles with constant speed and random torque. The angular velocities 
switches as a symmetric DMP between O = ±1.5. Different rates of transitions create different magni- 
tude of spreading as presented in the left figure. The right figure zooms into the left one to show the 
different trajectories. Other parameters: vq = 0.5 [359) 



and we have omitted the initial values. The common probability density to have an angle ip at 
time t then follows from 

P{^,t) ^ P+i^,t) + P^{p,t) (232) 

which will be used for the determination of the effective spatial diffusion coefficient. 

We proceed to discuss the physical situation in two limiting cases. First we neglect the 
Gaussian fluctuations. We put D ~ Q and subsequently = 0. Then the evolution of P{Lp,t) 
is given by the telegraph equation ([25)) 

For large times t 1/ A and (p — (po out the term with the second derivative can be neglected. 
One gets again a diffusion equation for the angel dynamics. In result, again a Gaussian density 
is established as in Eq. ((72|) . The effective angle diffusion coefficient follows as 

D<p = '^- (234) 

In the second case we look at the governing equation for the common probability density 
function including the Gaussian noise. It looks complicated 

d s 1 5^ N D^d^P(ip,t) 

5t^(^'^)=-2Aa^^(^'*) + XW^ 

d^p{v,t) Dld^p{^,t) 



but this equation simplifies significantly in the limit of fast switching A — > oo. Additionally we 
assume in this limit a fixed oj^/A = const. Then, the evolution operator again reduces to a 
simple diffusion equation 

Changes of the angel becomes diffusional with the effective diffusion coefficient possesses 



(237) 
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In addition to the intensity of the Gaussian angel noise a second contribution arises from the 
switching. Again the time dependent solution has a Gaussian form (j72p and the wrapped 2tt- 
periodic solution corresponds to Eq. with (|237p . We mention that both limits correspond 
to the Gaussian white limits of the stochastic force fi{t) in the Langevin equation for the 
angle dynamics, with fixed velocity v = vq and g{v) = I/vq. In this approximation Hit) was 
interpreted as a second Gaussian white noise in (|69p , which is uncorrelated with the stochastic 
term ^(t). 

Eq. (|236p and its Gaussian solution are valid in the limit of large angle and long times. 
It turns to be out that the corresponding approximation is insufficient to obtain the correct 
value of the effective spatial diffusion coefficient Doff describing the motion of the particle in 
a plane. The latter is strongly determined by the small angle behavior (long stretches without 
considerable turning). The largest contribution to the spatial diffusion stems from trajectories 
corresponding to long stretches along the same direction, i.e. is determined by the small-angle 
behavior. 

Therefore, before turning to the calculation of the spatial diffusion coefficient, we discuss a 
renewal approach which allows a generalization to a non-Markovian case as well as leads us to 
the effective angular diffusion (|237p more directly. 



Renewal model for two operating orientations 

The previous section dealt with a Markovian dichotomous switchings. Hence, the times spent 
within two states with fixed direction of rotation are distributed exponentially. Here, we gen- 
eralize to arbitrary distributions of the switching times jl47j . A different techniques will be 
applied, which is based on a continuous time generalization of a persistent random walk, in 
particular our analysis applies methods developed in Ref. j225ll47| . 

We consider the switching between the two states as an alternating renewal process. The 
probability density function of the sojourn time r in each state is given by a function w(t). 
In each of these states the motion rotates with the constant angular velocity ±w. The overall 
process is expressed as a sequence of steps in ipi, each of which corresponds to the sojourn in 
one of the rotational states; the overall 

As in Eq. (|199p for the position, the angular displacement cp{t) of the system is given as 
the sum of the displacements ipi in n completed steps probably followed by the last, {n + l)st 
incomplete step: 

n 

ip{t) = ^Vi + ■ (238) 

1=1 

The corresponding joint probability density function (pdf) h{ip,T) of the displacement ip and 
the duration r of a completed step in a corresponding state can be written as 

h±{^,T) = R±{^,t)w{t) (239) 

where R± {ip, t) is the conditional pdf of rotation for given step duration r. It is given by Eq. 
(|7^ with n = zbo;: 



R±{^,t) = ^ exp 



(240) 



As auxiliary functions in the approach of Ref. |225] we need the probability not to perform a 
step up to time t 

T 

W{t) = 1 - y w{T')dT', (241) 
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which defines the two distributions 

H±iip,T)^R±{ip,T)WiT) (242) 

corresponding to (|239p . 

The probabihties Q± to rotate over the overall angle (p just having completed a step corre- 
sponding to + or — state at time t read 

oo t 

Q±i^,t)= f dip fdt'h±{ip^^\t~t')Q^{ip',t') (243) 



It follows from the consideration that the temporal stay in one of the states (+/—), ending at 
time t is either the first stay, with the probability 1 /2 of being in one of the states, or the walker 
has already made several steps, and entered at time t', to its last + (— )-state. The latter ends 
at time t and since the process is a renewal one, transition depend on the last jump only. 
The probabilities P± still to be at ip at time t are 

oo t 

P±i^,t) = f dcp' f dt'H^{ip^ip',t~t')Q±{cp',t') (244) 



By adding the probabilities for ip at time t in both states one finally gets the common probability 
P{ip,t) for the angle distribution. 

The integrals in Eq. (j244p have the form of a convolution in spatial and temporal variables. 
Such equations transform into algebraic ones in the Fourier-Laplace domain where solutions 
can be easier found. In |147| the solution was given as 

^ g+(fc, S) [1 + fe_(fc, S)] + H-{k, S) [1 + h+{k, g)] 
' 2[l-/i_(fc,S)/i+(fc,S)] 

where p{k,s), p±{k,s) assign the Fourier-Laplace transforms of the corresponding probability 
density function. 

The Fourier-Laplace transforms of the densities h± and H± follow from the transformation 
of a Gaussian and from the shift theorem for the Laplace transform. They can be expressed as 

h±{k,S)^w{S + D^k'^±iu}k), H±{k,S) ^W{S + D^k^ ±iujk) (246) 

with W{u) = [1 - w{u)]/u. 

As example we consider again that the two states of the random torque fi{t) are due 
to a symmetric and Markovian protocol. In consequence, we take exponential waiting time 
distribution with rate A (see Ea. I23ip wit) ~ Aexp(— Ai). After corresponding Fourier Laplace 
transforms we 

obtain 

M S) = S + 2X + D,k^ 

' ' P + [Lj^ + 2XD^]k^ + Dlk^ + 2X§ + 2SD^k^' ^ ' 

It is interesting to underline that this solution from the renewal model solves Eq. (|235|) in the 
Fourier-Laplace domain. It will be used in the next paragraph to obtain the effective spatial 
diffusion coefficient which describes the asymptotic behavior of the particle. 

Let us shortly return to the diffusional approximation of the angular dynamics. We let 
s — >■ 0. The first term of the denominator (quadratic in s) can be neglected. Additionally we 
look at the limit of large overall turning angles taking leading terms in the limit fc — >■ 0, only. 
In this limit it one re-obtains angular diffusion with the effective diffusion coefficient defined in 
Eq. (j237l) . We remark that one gets the same result for any waiting time density w{t) if its first 
moment r = dt't'w{t') = 1/A [TTT] . 
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Spatial diffusion coefficient under two random rotation 

Eventually, we aim to calculate the spatial diffusion coefficient Doff on a plane for the situation 
with two random rotations and Gaussian angular noise. We apply again the Taylor-Kubo re- 
lation |97l302j taking d = 2 in Eq. (jl69p . For a motion with constant speed vq the correlation 
function Cw is governed by the behavior of the angular coordinate, only, so that 

Cvv(t) = wo(cos[(p(t)]) . (248) 

Here we assumed (p{Q) — 0. The diffusion coefficient reads 

Dcs = ^j (cos[(^(i)])di. (249) 



Let 

OO 

P{k,t) = {e''"<'):^ J dipeJ'"^P{ip,t) (250) 

— CXD 

be the characteristic function of the angular distribution at time t (its temporal Laplace trans- 
form gives us p(fc,s)). The mean value in the expression Eq. (|249p is then {cos[(p{t)]) ~ 
ReP(l,t). Therefore the Laplace transform of the latter expression in its temporal variable 
yields 

oo 

te-^* {cos[ip{t)]) = Rep(l, S) . (251) 

Since in our case the function p(l, .5) is real, the Re-symbol can be omitted. From comparison of 
Eq. (|251|) and Eq. (|249p . we obtain the diffusion coefficient for the considered particle dynamics. 
It reads following Eq. (|247p 

n., ^ i.5«l,0) = l.l-,JI±2^ (252) 



Using Eq. (|55|) we can rewrite the last expression as (147) 



^ ' D(D+2Xv'^) 

The first factor is the already often cited diffusion coefficient of active Brownian particles [231] 
which appears, for example, also in Eq. (|216p ). It defines the upper limit in the situation with 
two random rotations. We see that a directed turning motion decreases the diffusion process 
since the second multiplicand is always smaller than 1 if a; 7^ 0. It is the effect of the bounded 
motion along the circles and the precision along these curved trajectories which obviously 
decreases the effective diffusion. The dependence of the diffusion coefficient as function of the 
noise intensity D is presented in Fig (j39p for several rates of transitions A between the two 
angular velocities. 

Starting from Eq. (|253p this behavior is also found for cj = or in the case of high noise 
_D ^ 00. In this situation the second factor becomes unity. As A — )■ the particle will rotate 
always clockwise or counterclockwise without switching between the two turning directions. 
Then one obtains ^ 

D^ff = ^ L_ . (254) 

2L» 1 , fif^ ^ ^ 

i -I- _D2 



This result was previously derived in (302j . The effect of the switchings between the two values 
of uj decreases the value standing in the denominator of the second factor. Hence the diffusion 
coefficient decreases if switches between both turning directions are allowed. 
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D 



Fig. 39. Diffusion coefficient for active particle with negative and positive angular velocity u) = IQ and 
Wo = 1 vs noise intensity D. The upper curve A = 5 converges in good agreement with the dependence 
of Dcs for A — >■ oo. The lower curve corresponds to A = but averaged over both values of ±a;. 



Another interesting case is the Gaussian limit of the dichotomous phase velocities. As in 
the section 4 wc suppose the common limit A — > oo and — > oo holding thereby fixed their 
ratio. Then it follovifs ^ 

^-ff = , (255) 

It yield the result of Meinkohn and Mikhailov but with the increased noise intensity D — > 
D + cl'^?Jq/2A coming from the fast switches of the velocity-phase ip. 
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5 Stochastic dynamics of active particles in confining potentials 

In this section we address the question of active motion in external confinements and analyze 
the typical trajectories and distribution functions. Throughout this section we use passive 
fluctuation, independent on the direction of motion. 

Rotational motion of biological agents has been observed as a result of an external confine- 
ment |250 '249"132'. Furthermore, collective rotation is a very common mode of the motion of 
swarms P47j . Motivated by these observations, in order to imitate the rotational mode, we will 
therefore consider first a single particle in an external harmonic potential 

C/H(r) - ]^Lu\^ . (256) 

It is well known that this system possesses a stable solution corresponding to a circular motion 
with radius tq = wp/w [301] . In the absence of noise the angular momentum L = r x v is fixed, 
the direction of motion depends on the initial conditions. 

In this section we include an external potential in the description. In case of an constant 
force it will break the isotropy of the problem. In a large or an infinite space the presence of 
dissipation will create a situation with a constant velocity and we can cross to a co-moving 
frame. 

A more interesting situation is obtained for potentials which create a confinement. New 
dynamical solutions are then limit cycles in the phase space. In the following, we will restrict 
mainly to the discussion of the the Rayleigh-Hclmholtz friction. Then the problem of active 
Brownian motion in external attracting potentials transforms into the study of (higher dimen- 
sional) van-dcr-Pol oscillators with noise. 



5.1 Basic solutions for the active motion in harmonic potentials 

Let us first study the active motion of a Id driven oscillator without noise, which for the 
Rayleigh model is described by [5] 

^=w, ^+ujlx = v{a~ Pv''), (257) 

where Wq = a//3 defines the stationary velocity. Fig HOI shows the results obtained from integra- 
tion of (|257p . The systems exhibits self-excited oscillations, so-called limit cycles - as discussed 
already by Rayleigh in 1894 |279j . An approximative solution for small driving (small values of 
a) [5] reads 

x{t) = ro sin(wot + ^), v{t) = vq cos(tJoi + ^), (258) 

where the amplitude of the oscillations is = wq/'^o and the energy is i?o = fnvQ. This 
approximate solution is valid for all active friction functions which have one zero at wq. Any 
initial condition if the x, v space converges to the circle 

H{x, v) = imw^ -f ]^ujIx^ = 2vl (259) 

This circle is an attracting limit cycle of our system [9]. In a next step we will study two- 
dimensional oscillators. We specify the potential U (r) as a symmetric harmonic potential in 
two dimensions: ^ 

U{xi,X2)^-ool{x\+xl) (260) 

First, we restrict the discussion to the deterministic case, which then is described by four 
coupled first-order differential equations: 



xi=vi, wi = -7(ui,U2)ui -wgxi 

X2=V2, V2^ -liyi,V2)v2-Ujlx2 



2^ (261) 
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time t 

Fig. 40. The coordinate x{t) and the velocity v{t) for limit-cycle oscillations of a Id driven oscillatory 
systems. The active particle is driven by a Rayleigh friction force. Parameters: q = l,d = 0.8, c — 
0.1,70 =0.1 . 



In the 2d case the energy pump of the r.h.s. of the velocity equation (|257p is generalized to 

jiv,,V2) = -a + 13 {vl + vl). (262) 

We can show by simulation and theoretical considerations that two limit cycles in the four- 
dimensional phase space are created [116] . The projections of both these periodic motions to 
the {vi,V2} plane is the circle 



2,22" , 

Vi + V2 = Vq = — = const. 

The projection to the {xi,X2} plane also corresponds to a circle 

x'i + Xn ~ rn ^ const. 



(263) 



(264) 



Due to the condition of equilibrium between centripetal and centrifugal forces on the limit cycle 
we have 



ro 



Therefore the radius of the limit cycle is given by 



ro ^ — 

Wo 



From equation (|265p follows 



1 2 

2^° 



„2 



(265) 



(266) 



(267) 



This means we have equal distribution of potential and kinetic energy on the limit cycle |101j . 
As for the harmonic oscillator in 1-d, both parts of energy contribute the same amount to 
the total energy. Therefore the energy of motions on the limit cycle, which is asymptotically 
reached, is twice the kinetic energy 



H 



(268) 
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Fig. 41. Stroboscopic plot of the 2 limit cycles for driven Brownian motion. We show projections of 
solutions for no = 1 to the subspace {xi,X2,vi}. 



The energy is a slow (adiabatic) variable which allows a phase average with respect to the 
phases of the rotation [116] . 

Two exact stationary solutions can be easily found. The first cycle in the four-dimensional 
phase space reads with arbitrary initial phase <P: 

Xi ~ vq cos{ujQt + vi = —rQUj sin(aJot + <P) 

X2 ~ tq sm{u!Qt + <P) V2 = roU! cos{ujQt + <P) 

This means, the particle rotates even for strong pumping with the frequency given by the 
linear oscillator frequency loq. One can check that this is indeed an exact solution of the dynamic 
equations. The trajectory defined by the four equations looks like a hoop in the four-dimensional 
phase space. Most projections to the two-dimensional subspaces are circles or ellipses however 
there are to subspaces namely {xi,V2} and {x2,vi} where the projection is like a rod. 

The second limit cycle is obtained by inversion of the motion, i.e. t — >■ —t,vi{Q) — wi (0) , W2 (0) 
~V2(0), loq — > —luq which yields 

xi = ro cos(woi ^ ^) vi ~ —rooj sin(a;o^ ^ ^) 

X2 = —ro sin(cjot ^ ^2 = —rouj cos{uJat — <P) . 

This second cycle forms also a ring in the four-dimensional phase space which is different from 
the first one, however both limit cycles have the same projections to the {xi,X2} and to the 
{I'l, V2} plane. The projection to the xi — X2~ plane has the opposite direction of rotation in 
comparison with the first limit cycle. The projections of the two rings on the {xi, X2\ plane or 
on the {wi,W2} plane are circles fFigure HTj) . The ring-like distribution intersect perpendicular 
the \x\,V2\ plane and the {x2,t'i} plane (see Figure HT|) . The projections to these planes are 
rod-like and the intersection manifold with these planes consists of two ellipses located in the 
diagonals of the planes (see Figure HI]) . 

The main effect of noise is the spreading of the deterministic attractors. Thus, in the presence 
of noise, the two ring-like embracing limit cycles are converted into two crossing toroids with 
cross-sections increasing with increasing noise intensity (see Fig. . 
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We already examined that in the case of dimension d ~ 2 a very useful representation is 



obtained in polar coordinates jSOlj . Following Eq. (fTSj) and with 

X = r{t) cos (■0(0) : y = sin (V'(i)) • (269) 

we introduce polar coordinates r{t),'>p(t), s(t),ip{t) in the four-dimensional phase space (r,v) 
for the case of active motion. One easily obtains the dynamics similar to Eas. (|270|) 

r = vcos6^ s = —^{s)s ~ ujr cos 6 

(270) 



^0 



s \ ' s 

- sin0, ip — - aint 
s r I r 



with 9{t) ~ if ^ ip. 

The stationary solutions (Eqs. 12691 I269p can be easily found. The difference of the two 
angles 9 approaches two values, 6 — ±7r/2. These two solution resemble the two limit cycles 
with vq = a/ 13, tq = vqujo and two stationary rotations (clockwise and counter clockwise) with 
stationary angular velocity tjj ^ (p ~ iwQ. 

This means, the particle rotates even at strong pumping with the frequency given by the 
linear oscillator frequency ujq. The trajectory defined by the above four equations looks like a 
hoop in the four-dimensional phase space. Most projections to the two-dimensional subspaces 
are circles or ellipses however there are to subspaces namely {xi,V2} and {x2,vi} where the 
projection is like a rod. 

In order to construct solutions for stochastic motions we need beside H = Vq other appropri- 
ate invariants of motion. Looking at the first solution (j269p we see, that the following relation 
is valid 

vi + OJ0X2 = 0; V2 — ujqXi = 0. (271) 
In order to characterize the first limit cycle we introduce the invariant 

J+=H-LJnL = i(wi + ujoX2f + ^(«2 - ujoxi)^. (272) 

where we have introduced the angular momentum L = {xiV2 — X2V1). We see immediately that 
J+ = holds on the first limit cycle which corresponds to positive angular momentum. In order 
to characterize the second limit cycle from equation (j269p we use the invariant 

J- = H + U!qL = i(wi - LOoX2y + ^{V2 + WqXi)^. (273) 

We see that on the second limit cycle, which corresponds to negative angular momentum, holds 
J_ =0. 



5.2 Rotational motors and efficiency 

A two dimensional system in rotational mode may be considered as a simple model of a rotating 
motor. Wc consider again the 2d oscillatory system (|26ip this time for the general case of a 
friction function having one zero "f{vo) = 0. As shown above we are able to find even an exact 
solution for the limit cycle oscillations (|269p for the Rayleigh-Helmholtz case. The solution 
(|269p represents a (mathematically ) positive rotation. The motion of the particle on the orbit 
in distance tq from the center proceeds with velocity vq and runs in time t over a path of length 

l{t) = vot + l{0) (274) 



on the orbit. On this path the motor is doing work against the friction 79. 
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Generating rotations is connected with angular momentum L = r x v which satisfies the 
equation of motion 

^ = -7(v)L (275) 

In the 2d-case the self-generated angular momentum of the stationary solution is L = roVQ. 

Let us assume some torque M^^ acting in opposite direction, then the "motor" has to 
perform some additional work. For simplicity we assume that there is some opposite force 
acting along the circumference of the circle with Mq = r^F^x- We assume this force, as some 
additional friction F^x = —Fvic acting in the direction opposite to the direction of (rotational) 
motion. We define vic < vq as the velocity of the motion along the limit cycle, with vic = vq for 
the unperturbed limit cycle. 

Let us consider the depot model (see Sec. I3.2.4)) . The velocity along the limit cycle without 
the additional torque reads 

-0 = --- (276) 

If we take the additional load into account the velocity along the limit cycle changes to 

2 Qo do 



(70 + n c 



(277) 



The power associated with the additional work is P = F^xVic and we define the efficiency as 
the relation of the generated power P to the fiow of energy into the system q^: 



^ go go qo 



1 d 



70 + r cqo 



(278) 



for FexVic > 0. The corresponding dependence on the external additional friction F is rep- 
resented in left Fig. 1421 For a clear understanding we should emphasize that 70 is an alway 
present internal friction, while F is connected with the external load and therefore connected 
with the work performed against the external force. The dependence of the power of the motor 
on the external friction for different motor parameters is represented in the right panel of Fig. 
1421 Depending on the internal motor parameters, we observe typically a curve with a maximum 
at a finite load corresponding to maximal efficiency, which in our examples is around - or less 
than - 50 percent and is achieved for 

r^ax = {cqo/d) - 7o. (279) 

After the maximum the efficiency decreases with increasing F. Above a maximal value of exter- 
nal friction, corresponding to vanishing velocity along the limit cycle vic = 0, the motor stops 
to work and the efficiency becomes formally negative. The curves for the efficiency of rotational 
motors shown above may give us some idea about the efficiency of biological motors responsible 
for the mobility of animals, whereby the simple model model discussed here reproduces the 
generic behavior expected to hold for all biological motor systems. We mention in particular 
the measurements and discussions of the efficiency of the kinesin motor |153I371I372| . 



5.3 Stochastic motion in a harmonic external potential 

Since the main effect of noise is the spreading of the deterministic attractors we may expect 
that the two hoop-like limit cycles are converted into a distribution looking like two embracing 
hoops with finite size, which for strong noise converts into two embracing tires in the four- 
dimensional phase space. In order to get the explicit form of the distribution we may introduce 
different variables, like the amplitude and phase description as used in the previous sections. 
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0.25 0.5 0.75 1 0.5 1 1.5 



Fig. 42. Left: Dependence of the power of the "motor" on the external friction F generated by the 
load force for three different values of the internal motor friction 70 and fixed the other parameters 
c = 0.5, d — 0.5, g = 1. Right: Dependence of the power of the "motor" on the external friction 
r generated by the load force for four values of the conversion parameter d of the internal motor 
parameters (other parameters: 70 ~ 0.2, c = 0.5, go = 1-0). We note that the efficiency decreases with 
increasing parameters d. 



Here we introduce the energy and angular momentum as variables and derive reduced densities. 
We remember that throughout the Stratonovich calculus is used [9] . 

On the basis of the amphtudc and phase representation (polar coordinates) and (|269p 
we get for the Hamiltonian 

1 



The angular momentum is given as 

L{t) = {xiV2 - X2V1) = s(t)r{t)cos{6). 
Values corresponding to the two limit cycles are 

L = +Lo; L = —Lq; 



(280) 
(281) 
(282) 



with Vq = a/ 13. Both limit cycles are located on the sphere with H{t) = Vq. 

Considering harmonic oscillators and using equipartition of potential and kinetic energy (see 
equation (|268p ') wc find for motions on the limit cycle s^(i) = H{t). Assuming that ^ H 



holds also near to the limit cycle, the dynamic system with the pump (j262p is converted to a 
canonical dissipative system with 



7(s2)~7(i7)=7H(i?). 
This way we come for the Raylcigh-model to the energy balance 

d 



At 



(283) 



(284) 



where £,H{t) = £,i{t) cos{(j)) + ^2{t) sm{(j)) is again Gaussian white noise and Dh = D. This 
corresponds to the Fokkcr-Planck equation in energy representation 



(^HiH) H - Dh) P + Dh ^ H P 

on 



which stationary solution reads 

Po(i?) = A/'cxp 



(285) 



(286) 
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The most probable value of the energy is the energy on the limit cycle. In case of the Rayleigh 
model it is 

,.2 



H = Hn = -=U 



The stationary distribution can be given in compact form [H > 0) 



2D 



(287) 



(288) 



which is a Gaussian at positive energies. 

This probability is in fact distributed on the surface of the four-dimensional sphere. By using 
equation (j280p we get for the Rayleigh- model of pumping in our approximation the following 



distribution of the coordinate with = + 



Poixi,X2) ^ cxp 



auj, 
~D 



„2 



2rl 



(289) 



We see in figure 12891 that the probability crater is located above the trajectory obtained from 
simulations of an Active Brownian particle. This way the maximal probability corresponds 
indeed to the deterministic limit cycle. 




Fig. 43. Probability density for the Rayleigh-model represented over the {xi,X2\ plane, (a) The 
probability density 1)289^ . (b) Contour plot of Pa{r) superimposed with data points out of simulations 
of the Active Brownian dynamics. Parameters: q = 2, 73 = 0.1 and i^o = 1 



So far we represented only a projection on the {xi,X2\ plane. The full probability dis- 
tribution in the four-dimensional phase space is not constant on the four-dimensional sphere 
iJ = Wg as suggested by equation (j286p but should be concentrated around the limit cycles 
which are closed curves on the four-dimensional sphere H = Vq. This means, only a subspace 
of this sphere is filled with probability. The correct stationary probability has the form of two 
noisy distributions in the four-dimensional phase space, which look like hula hoops. This char- 
acteristic form of the distributions was confirmed also by simulations (see figure [5T51 and |116j ). 
The projections of the distribution to the {xi,X2} plane and to the {vi,V2} plane are noisy 
tori in the four-dimensional phase space. The hula hoop distribution intersects perpendicular 
the {xi,V2} plane and the {a;2,wi} plane. The projections to these planes are rod-like and the 
intersection manifold with these planes consists of two ellipses located in the diagonals of the 
planes. 

In order to refine the description we find the distribution of the angular momenta. We start 
from the Langevin equation 



(290) 
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with ^L{t) — £,y{t) cos(0) — £,x{t) sin(0) being Gaussian white noise. On the limit cycles it holds 

L{t)^±r{t)s{t), s{t) ^uJor{t), (291) 

respectively, the different signs for the different cycles and r{t) — and s{t) = vq. To find a 
closed description we assume that the equations ()29ip hold and replace 



rit) 



where we have used the positive sign and hence L > 0. It follows 



(292) 



with 



-L = -7l(L) L + ^2DLL^L{t) 



D 



Dl = — 



The corresponding Fokker-Planck equation is similar to the energy representation 



(7i(L)L - Dl)P + Dl—LP 

oL 



Obviously its stationary solution reads 

Pq{L) = AAexp 



Dl 



IlWL 



(293) 
(294) 

(295) 
(296) 



and eventually after introducing the most probable angular momentum Lq = fa^o ~ Hq/loq at 
the limit cycle the stationary solution becomes (L > 0) 



Po{L) = A/'cxp 



(297) 



A corresponding solution can be found for the second cycle by replacing Lq — >■ —Lq for momenta 
with L < 0. Since due to symmetry both values are provided with same probability one may 
expect a linear superposition of the two solutions 



Po{L)=U(cxp 



2D ^ ' 



cxp 



2D 



[L + Lo) 



(298) 



The given method does not provide a complete solution in the four-dimensional phase space, 
but gives us a good idea about the projections on different planes. In order to find a distri- 
bution in the four-dimensional phase space we combine the previously found distributions and 
introduce the invariants J+, which leads to the following ansatz: 



^o(a;i,x2,ui,V2) = A/'cxp 



(299) 



cxp 



2D-^+ 



exp 



2D- 



We may convince ourselves that this formula agrees with all projections derived above. Fur- 
thermore, it is in agreement with the general ansatz derived in earlier work from information 
theory |97I102| . Since our new expression for the stationary distribution does not contain any 
parameter characterizing the concrete potential it may be applied to arbitrary radially sym- 
metric potentials, in particular we may use it for describing the stationary distributions for a 
Coulomb confinement. 
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5.4 Dynamics in symmetric anharmonic potentials 

Here we will discuss briefly several extensions of the theory developed in the previous section 
following |301j . At first we will discuss the case of anharmonic potentials. For the general case 
of radially symmetric but anharmonic potentials U{r) the equal distribution between potential 
and kinetic energy mvQ = ar^ which leads to ujq ^ vq/vq ^ uj is no more valid. It has to be 
replaced by the more general condition that on the limit cycle the attracting radial forces are 

2 

in equilibrium with the centrifugal forces. This condition leads to = |J7'(ro)|. Then, if vq is 
given, the equilibrium radius may be found from the relation 

vl^ro\U\ro)\. (300) 

The frequency of the limit cycle oscillations follows as 

.2 = 4-!^. (301) 

For example, for the case of quartic oscillators with potential U{r) = kr'^/A we get the limit 
cycle frequency 

^0 = ^ (302) 

Alternatively for attracting Coulomb forces U{r) = — Ze'^/r the stable radius reads and the 
limit cycle frequency, respectively. 



Ze2 



''o = , t^o = (303) 



Integrals of motions follow 

Ro = -\vl; Lo = ±—. (304) 



"0 



We note that this expression diverges for vq — > (similarly as in quantum theory the Bohr 
radius diverges for /i — > 0). 

If the equation p00[) has several solutions, the dynamics might be much more complicated, 
e.g. we could find Kepler- like orbits oscillating between the solutions for ro- In other words we 
may find then beside driven rotations also driven oscillations between the multiple solutions of 
equation (|300p . 

An interesting application of the theoretical results given above, is the following: Let us 
imagine a system of Brownian particles which arc pairwise bound by a Lennard-Jones-like po- 
tential U(ri —r2) to dumb-bcU-like configurations. Then the motion consists of two independent 
parts: The free motion of the center of mass, and the relative motion under the influence of 
the potential. The motion of the center of mass is described by the equations given in the 
previous section and relative motion is described by the equations given in this section. As a 
consequence, the center of mass of the dumb-bell will make a driven Brownian motion but in 
addition the dumb-bells are driven to rotate around there center of mass. What we observe 
then is a system of pumped Brownian molecules which show driven translations with respect 
to their center of mass. On the other side the internal degrees of freedom are also excited and 
we observe driven rotations and in general (if equation pOOp has several solutions) also driven 
oscillations. In this way we have shown that the mechanisms described here may be used also 
to excite the internal degrees of freedom of Brownian molecules. 



5.5 Dynamics in asymmetric potentials 

We will study now potential landscapes without radial symmetry and follow |112| . Problems 
which we might be to studied by help of these models are, for example, the synchronization 
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between the oscillations along both axis, the existence of Arnold tongues etc. |113j . In the 
simplest case, we may assume that the potential is harmonic along the two axes but stretched 
in an asymmetric way with different elasticity constants 

U{x,y) = \Lolx^ + \ujly\ (305) 

denoted by wi ^ loi. In order to give some idea about the influence of asymmetry between the 
modes led us first present the result of simulations for 1000 independent active particles with 
the depot pump (see Sec. 13.1. Sp . The distribution of these particles in the phase space shows 
us how the probability distributions are expected to have their maxima (see Fig. I44p 




Fig. 44. Distributions according to simulations of 1000 active Brownian particles with depot pump 
(Sec. I3.1.3P on limit cycles in symmetric (a-c) and asymmetric (d) parabolic potentials, a) We show 
projections of simulations on the x — y— plane. Parameters: C, — 1.5, 70 = 1, -D = 0.01: (a) 2D projections 
on the subspace {xi,X2}, (b) 3D projections on the subspace {xi,X2,V2}, (c) 2D projections on the 
subspace {xi,V2}, (d) 2D projections on the subspace {xi,X2} for UJ2 = [113| . 



We also study here a specific case of a simple relation of the frequencies (jJ2 = The 
solution of the Hamiltonian problem (e.g. no dissipation) is given by 

X\ = r\ co'a{uj\t — <P) vi = — 7'iWi sin(ajit — <?) 

(306) 

X2 = r2 sin(2a;ii — <P) f 2 = 2r2Wi cos(2wii — (p) 

where the amplitudes ri^2 are determined by the initial conditions. In the case of active particles, 
(5 = C + 1 > (see Eq. EH), the dissipative forces drive the trajectories to an attractor which 
corresponds to + — > In a good approximation the attractor is determined by the 
amplitudes, 

ri = — ; r2 = — . (307) 
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Wc sec that the smaller amplitude has approximately half the value of the bigger amplitude. 
This way we have obtained a limit eycle shaping like a Lissajous oseillation in the form of an 
"8"; a seeond limit cycle can be found by inversion of the trajectory. The result of a stochastic 
simulation is shown in Fig. 23] (d). We see here the projections of two stochastic trajectories 
(limit cycles); the projections having the form of an "8" . In the case of irrational relations LO2/0J1 
as well as for the case of nonlinear couplings between the modes we find more complicated 
attractors |113j . In order to get analytical expressions for the distributions we may introduce 
amplitude-phase representations |116| . 



5.6 Transitions bistable potentials 



Let us now have a look at bistable situation in a two-dimensional landscape following [99]. 
In order to investigate the Kramers problem of transitions between two wells we introduce a 
simple model potential with two potential minima placed on the line x = y. The potential is 
defined by 

U{x,y) = ai^z" - ^z^ - cz) + ]^lo\x - yf. (308) 

Here we introduced z = [x + y)/2 being the reaction path, i.e. the co-ordinate along the line 
connecting the minima with the lowest barrier value between both. The parameter c determines 
the asymmetry of the wells and a determines the height of the well which is for (c = 0) given by 
AU = a/4. The shape of the potential is presented in Fig. ps)) . In the case of small excitation 
energy Vq/2 <^ AU, and weak noise, the dynamics in each well is similar to the parabolic case. 
In other words we may observe two limit cycles in each of the two wells. With increasing noise, 
transitions between the two wells become possible. For standard Brownian motion this is a 



well-studied problem [152j . 

Here we present numerical simulation of 10000 active particles with depot pump of energy 
(see Fig.[31)and provide estimates of the transition rates (Fig. 051 Initially particles were put at 
z = Zq in the left potential well. In Fig. |45] (b,c) the temporal evolutions of the position of the 
center of mass Z{t) and the fraction of particle in the left well, p{t) = ni{t)/N are shown, ni is 
the number of particles in the left well and N = 10000 is the total number of particles. As can 
be seen from the figure, the time courses can be fitted with exponential laws: 



Z(t) = Zoexp( 



Pit) = I 



1 



expl 



(309) 



where r is the characteristic transition time. The transition rate 1/r is shown in Fig. I45f d*) as 
a function of S. A rough estimate of the transition time is 



T oc exp 



AU - 



D 



(310) 



where Vq = ((5—1) for our model. Thus, with the increase of 5 the potential barrier is effectively 
lowered, providing higher transition rates which agree with the result for the one-dimensional 
case |271| . 

In other words, the effect of active driving (in comparison to the passive case) may be 
estimated by 



OC exp 



2D 



(311) 



Due to the nearly exponential dependence on ((5 — 1) the increase of the rate with the driving 
strength may be rather large. We have to note, however, that the exponential "ansatz" yield 
just a rough estimate for moderate pumping 1 < 6 < 2. For S > 2 we observe in FigUS] (d) 
already a tendency to saturation (the particles freely penetrate the barrier) and for S < 1 
(transition to the passive case) we observe a more sensitive dependence on the parameter S. 
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Time, t 



Fig. 45. Active Brownian particles in a bistable potential in 2 dimensions, (a) The shape of the 
potential for AU = 1 : a = 4, c = 0, the minima are located along the diagonal, (b) The position of the 
center of mass of 10000 particles initially located in the left well under the influence of noise D = 0.1 
as a function of time, for indicated values of driving parameter 5. The transitions are enhanced for 
larger driving, (c) The fraction of particles staying in the left well for D = 0.1 (d) The decay rates of 
the probability to stay in the left well for the noise strength for D = 0.1 and for D = 0.2. On (b) and 
(c) symbols shows numerical values, while the solid lines are exponential least-square fits due to Eqs. 
dSnU- Other parameters (see Fig.EJ: 70 = 1; t^d = 1 [HI] 
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6 Collective motion and swarming 

We apply in this section the model of active Brownian dynamics to describe the collective 
motion in active matter systems, such as e.g. swarms of animals. 

At first we will characterize the fundamental modes of collective motion of swarms with 
cohesion using a quite simple model based on the idea of global coupling of the individuals in 
the swarm. Global coupling is not based on realistic physical interactions however it demon- 
strates already the most important features of "swarms" . We use here the general notation of 
"swarms" for confined systems or clusters of particles which can perform collective motion far 
from equilibrium. 

After the discussion on modes of collective motion induced by global coupling, we will 
turn to the important class of models of collective motion due to local, short-range velocity 
alignment between active particles. We will start with a description of active Brownian particles 
with nonlinear friction and velocity alignment. Further on, we proceed with the discussion of 
a widely used class of self-propelled particles, which correspond to limit of vanishing speed 
fluctuation. In this context we will focus on different interaction symmetries. Starting from the 
classical Vicsek model of active polar particles with polar interactions, we discuss a general 
classification of models that includes not only so-called active nematics, but also a second 
important class of models of active polar with apolar interactions. Throughout this second 
subsection, we will focus on the onset of collective order for increasing density or decreasing 
noise in various models. 

Finally, in the end of this section we will introduce alternative mechanisms for swarming and 
collective motion based on escape and pursuit response or chemotactic behavior of individuals. 



6.1 Dynamics of swarms 

6.1.1 Modes of collective motion with cohesion: translation and rotation 

The model of global coupling is the most simple dynamical model of collectively moving swarms 
of animals. Global coupling is not based on realistic physical interactions however it demon- 
strates already the most important features of "swarms" . 

Probably one of the first individual based model mathematical model of swarms was in- 
troduced by Suzuki and Sakai in 1973 ( [333j : see also |247) ) . Since then, different models of 
swarming of animals, many of them motivated by fish schools, have been the subject of biologi- 
cal and ecological investigations (see e.g. |10ll67l247l70l69l40j V Here we would like to highlight 
the pioneering paper on swarm dynamics by Hiro-Sato Niwa published in 1994 j245| . Niwa, 
not only introduced a nonlinear friction function in his model, but he is probably the first one 
who analyzed the stability of the different modes of swarming motion from the point of view of 
statistical physics. Despite the numerous biologically motivated studies, swarming dynamics is 
still a rather young field of physical studies. Some recent developments have been covered, for 
example, by Helbing jl54) . who discusses traffic and related self-driven many-particle systems 
and the comprehensive books by Vicsek |353] . Mikhailov and Calcnbuhr [230] . and Schweitzer 
[306] . 

Based on the simulation studies of the first swarming models [333| , a classification of different 
modes of swarming motion was performed, which can be also observed in nature (see Okubo 
and Levin |247j l According to these authors, three general modes of motion can be identified: 

1. translational motions, 

2. rotational excitations and 

3. amoeba-like motions. 

It is beyond the focus of this review to discuss all the swarming models, which were developed 
in order to account for the rich variety of observations. Instead, we will study in the following 
the collective modes and the distribution functions of simple models. We start here with con- 
sideration of finite systems of particles confined by global coupling which are self-propelled by 
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active friction and parallelized by small velocity-dependent interactions. This kind of descrip- 
tion may be considered as a simple and to large extent analytically tractable approximation of 
the collective dynamics of biological agents [?32 100 30 8 95 111 114 lU^ . More complex models, 
which incorporate for example local interactions, are discussed in the forthcoming sections as 
well as in other publications (see e.g. Refs. |354I72I353I355| ). 

We will show here that the collective motion of swarms (large clusters) of driven Brownian 
particles resemble very much the typical modes of motion in swarms of living entities. The 
self-propulsion of the particles is modeled by active friction as introduced in Sec. 13.1.21 The 
analysis is restricted to two dimensional models (d = 2). The internal driving of the system by 
negative friction yields a dynamical behavior far-from equilibrium. Earlier studies have shown 
that such active interacting systems may have many attractors and that noise may lead to 
transitions between the deterministic attractors |232I308) . 



6.1.2 General model of swarms 

We proceed with an analysis of the structure of the equations of motion of a swarm. We 
will characterize the motion by its attractors in the phase space and again by the stationary 
distribution if noise is included. First we start with the two dimensional problem and harmonic 
interactions. In the next section generalizes to three spatial dimensions and to interaction with 
Morse potentials. 

We consider a system on N active particles at positions (ri(t), . . . , rN{t)) which are moving 
with velocities Vi{t), . . . ,vis[{t)). Let the particles be point-like with the mass m = 1. Since 
motion is created by forces we postulate the equations of motion for the individuals within the 
swarm to be given given by the TV (stochastic) Newtonian equations 

V, , (312) 

-7(vOv, + F,(ri, . . . , rjv, vi, . . . , VA,) + V2D^,{t), (313) 

where are Gaussian white noise sources acting on every particle, independent from other 
particles. 

The first term on the right hand side is the dissipative force, which accounts for the individual 
velocity dynamics (friction/energy pump). In case of the Rayleigh-Helmholtz model (Eg. 
these forces are read 

-7(v,)v, = (a-/3v2)v„ (314) 

Also the active linear dissipative force with friction coefficient can be easily generalized 
to N particles. Eventually one can define for every particle i = I, . . . , N an individual energy 
depot ei{t) which will yield a velocity-dependent friction force 

The second force term accounts for the interactions between the particles, as well as 
possible external forces acting on individual particles. In general, it can be a function of all 
positions and velocities of particles forming a swarm. Here, we assume that consists of two 
components: a velocity dependent (dissipative) force and a force due to potential gradients: 

F, = Fr(vi, . . . , vat) - V;7jv(ri, . . . , ta,) . (315) 

The potential Un is assumed to consist of an external potential VF(ri) and a superposition 
of pair- wise interaction potential U{rij), with ry being the distance between particle i and j. 
Hence, the total potential reads: 

i ij 

We will start with a parabolic approximations of the interaction forces generated by the 
pair- wise potentials |232I100I308"] . 




(317) 
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which might hold if the size of the objects is small compared to the spatial scale of their motion. 
Harmonic interaction potentials constitute a global coupling between individual particles, which 
was considered in this context in various publications [24 5 232 308]. It allows to reduce the 
problem effectively to the motion in a well formed by harmonic forces which we considered in 
Section 15.11 With global coupling the particles are attracted by an effective spring force to the 
center of mass given by 

rc.o.™.W-^E^jW- (318) 

j 

The effective mean field force acting on the i-th particle is defined by 

Ki = -ViJ7Ar(ri,...,rAr) = -Wo[r, - rc.o.m.(t)] ■ (319) 

Several approaches to include more realistic interactions will be discussed later on. Here we 
mention that the case of constant external forces was already treated by Schienbein et al. 
|300l299j . Symmetric parabolic external forces were studied in Refs. |101I116| and the non- 
symmetric case is being investigated in Ref. |113| . More complicated external fields including 
short range repulsion were studied in detail in several publications |222I221I99I301| and will 
also be addressed in Sec. 16.1.61 

The dissipative interaction between particles, is assumed to be a velocity-dependent interac- 
tions with the tendency to synchronize the velocities of different particles. We assume a simple 
alignment law [247] 

Fr(vi,...,v^) =-Ai^gjv(r.,)(v,;-v,). (320) 
i 

Here g{r) is a function which accounts for possible distance dependence of the interaction, such 
as decay of the interaction strength with distance. This models a dissipative force which tends 
to parallelize the individual velocities. 

In this and the next section, we will consider for simplicity a velocity coupling with an 
infinite range: (7Ar(r) ~ 1/A^. Thus, in this model all particles synchronize with the total swarm 
velocity u(t) which is the velocity of the center of mass (c.o.m.) of the swarm. 

"W^^E^J- (321) 

j 

In addition we will assume that the alignment strength ^ is vanishingly small. Hence, in the 
next section our focus lies on the conservative interactions. 

Other couplings with finite range g{r) have been studied in numerous previous publications 
(see e.g. [35413531591267] ). We will discuss the (local) alignment interaction in detail in Sec. 16. 2. 21 
There are other types of dissipative interactions, which lead to synchronization of individual 
velocities as, for example, hydrodynamic interactions [111123] or symmetry-breaking contact 
interactions, such as e.g. inelastic collisions [253I334I266I143] . We will discuss local velocity 
alignment in detail in the forthcoming sections. Here we restrict our investigation to the simplest 
model of velocity coupling - global velocity coupling. 



6.1.3 The model of harmonic swarms with global coupling 

The concept of global coupling has proven to be very useful for the investigation of stochastic 
systems [HI. For the case of Rayleigh-driving, the dynamical equations for center of mass and 
its velocity have the form [5S] 

^r,.„.™.(i) = u(t), (322) 

Au = [a - pu'] u - ((^^■')'" + (" ■ ^^■') + ^Ut) • 
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Therein Sri{t) = ri{t) — rc.o.m.(0 ^-^^ (5vi(t) = Vi(t) — u{t) arc the deviations of the individual 
objects from the center of mass, which obey 

^Sri = (5vi (323) 
-^,5vi + uj^Sn = [a - - /36v^ - /Su^] ,5vi - 2^(u • (5vi)u + V2D6^,{t), 
where the Gaussian white noise acting on the center of mass is defined as 

^"W^^E^^W' {Ut))^0, {U^ui)^j^SkiS{t-t'), l,k^x,y. (324) 

i 

The noise agitating the individual objects reads (i, j = 1, . . . , A^) 

-56 -^^-^u, {Si^)^0,m^kS^Jl)^S,JSklil-j^)S{t^V), (325) 

with k,l = X, y. We note that these noise terms are again independent of the motion of particles. 

Lets first look at dynamics of the center of mass. We start by decoupling is from the dynamics 
of the deviations by averaging with respect to Sw^. Approximately we get in this way 

^u=(ai-/?u2)u + V2^eu(t). (326) 

Importantly, here ai < a is determined by the positive mean quadratic dispersions of the Swi. 
The corresponding velocity distribution of the center of mass is 



P'^°\u) = Cexp 



N u u 

2D AD 



(327) 



This way we find the most probable velocity as Ui = uie^ with equally distributed and diffusing 
directions. It owns values of the speed 



ui = (328) 

which are smaller than the speed of an freely moving individual object which value was vq = 
^ aj fi. The shift with respect to the free mode depends on the noise strength D. The solution 
breaks down if the dispersion of the relative velocities (5v| becomes so large that the a\ becomes 
negative. With increasing noise we find a bifurcation to another mode which most probable value 
has speed ui = 0. 

This corresponds to the findings of Erdmann et al. jll4j which will be discussed more 
detailed later on. Fig. 01] illustrates the two typical behaviors which can be observed for small 
noise and for noise intensities above a critical values D'^"* , respectively. Further on we refer to 
ui 7^ as the translational mode and to the second mode, with vanishing center of mass speed 
U2 = 0, as the rotational mode. We will also see that both modes can be clearly defined in three 
spatial dimensions. 



6.1.4 Investigation of the dynamics of the relative motion of active particles 

Here, we discuss the dynamics of the movement of individual particles relative to the center of 
mass [98j . We begin with the analysis of the deterministic case without noise. The equations 
of motion are completely symmetric with respect to the particle index i. In other words, there 
are no cross terms including two different particles as i, j. This is a unique property of global 
coupling, the relative dynamics reduces completely to the binary problem, i.e., to the analysis 
of the (stochastic) dynamics of pairs of active Brownian particles. Therefore, we concentrate 
our investigation on the study of two active particles with a linear attracting force [113) . 
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Fig. 46. The two basic configurations of a noisy system obtained by simulations of of = 100 globally 
coupled active particles. We show snapshots in the space of the two coordinates {ujq = 0.2, n = 0). Left 
panel: D — 0.001, translational mode , right panel: D = 0.2, rotational mode [98] . 
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Fig. 47. Dynamics corresponding to the attractor region of the rotational motion of the pair: The left 
panel shows the decay of the kinetic energy of the center of mass to zero (rest state), as a function of 
time z(t) = u^{t) . The right panel shows projections of the velocities vi{t),V2{t) as a function of time 
and demonstrates the formation of sustained oscillations [98]. 

In this case the center of mass rc.o.m. moves with the velocity u. The relative motion of 
an individual particle under the influence of the interaction force is described by the relative 
radius vector Sr = Vi — rc.o.m. = (ri — r2)/2 and the relative velocity Sv. The second particle 
has the same distance and velocity relatively to the center of mass but with opposite sign. We 
may write in Eq. (|323p simply Sr, (5v instead of dvi, ^v^ and omit the sum and the denominator 
l/(iV — 1) in the equation for the center of mass. 

i) Let us first assume a stable rotational mode. Hence we put u = which solves the 
equation of motion for the center of mass. Subsequently it follows that rc.o.m. ~ rc.o.m. (O)- in 
the two dimensional space the equations of motion for the 6r and (5v become symmetric and 
independent of a direction. Both assume the form of a van der Pol oscillator for system with a 
limit cycle 

^^r = Sw, ^Sw + Lj^Sr = (a - ^ - /^(Jv^) Sv . (329) 

As in the case of an external field (Sec. [S|) this system owns two stable limit cycles, see Fig. HT] 
Which of them will be approached depend on the initial conditions. 

This attractor is left if we introduce a translational motion with an ovcrcritical speed value. 
In order to understand this we introduce a small but finite translation u = vi > Vcrit > 0. If 
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u is sufBcicntly large, it leads immediately to a destruetion of the rotational symmetry of the 
limit cyeles, to an elliptie deformation with the longer axis in the direction perpendicular to 
the translation. As shown by Erdmann et al. jll3lll2| the loss of rotational symmetry leads 
to leaving an Arnold tongue of stability and consequently to a destruction of the limit cycles. 
These authors found that the rotations are indeed stable only in and near to the plane m = 
i.e. for swarms at rest or near to the resting state. This situation is presented in Fig. ST] for an 
subcritical initial kinetic energy of the center of mass. 

ii) In case of translational mode the vector u ~ e^, plays a special role we orientate the 
coordinate system relative to it meaning we span 5y = (.T|| , a;_L), 5w = (u|| , uj^) where , W|| are 
the components in the direction of u and x_\_,v±^ perpendicular to it. Further we introduce the 
coordinates zit) = corresponding to the twice the kinetic energy of the center of mass. 

Then we get the following five differential equations 

— = U|| , ^''^11 + "^0^11 = ''^11 (q^ ^ ^ 3/3^ — — Pv\) , 

^^z^2z{a-l3z-iPvl~(3vl),. (330) 

supplemented by the definition Vc.o.m. = u- The qualitative analysis of this system of nonlinear 
ordinary differential equations shows at first that the system possesses a stable point attractor 
at z = a//3, U|| = v±^ = xy = a;j_ = 0. With parabolic attraction without hard core both particle 
has the same position and move with the center of mass velocity . Note that this is also solution 
for the iV-particles. 

The linear stability analysis provides the eigenvalues —2a in z-direction, in the parallel 
direction Ai±icri where Ai = {2a-\- ji) /2 and cti — -^/Af— and in the perpendicular direction 

Al ± iai with A2 = /i/2 and (T2 — \/ ^2 ~ "^o ■ '^^^'^ point attractor is linearly stable provided 
/i > 0. The linear stability in the direction v±_ corresponding to the motion perpendicular to the 
translation is given only for /i > 0. However even at /i = we still observe quadratic stability 
in this particular direction due to the terms since the —Pv^ 
seen from the nonlinear equation of motion for around the fixed point 



d 

At " 



(331) 



Now we suppose that a deviation from the fixed point exist, which is realized by some small 
and I'll we do not claim that both are stationary but supplement each other to a stationary 

values. Afterwards we require that the expression inside th brackets in the last equation of 

P30p vanishes, i.e. it holds 

I3z = a - ijSvl - I3v\. (332) 

Since i = 0, the above expression (|332p represents a translational mode. The stability analysis 
shows that perturbations perpendicular to the motion perform harmonic oscillations around 
the center of mass if is vanishing. Otherwise the start to grow if there is a deviation parallel 
to the motion and the translational mode gets oscillating in all variables. 
Indeed insertion of (|332p into the dynamics of v± yields 

^^v^+Lolx^=v^{-^i + 2pv\), (333) 

So if /X — )■ this state is marginally stable if the deviation of the particle points perpendicular 
to the center of mass, i.e. wy = 0. Oppositely the deviations parallel to the direction of the 
center of mass will be amplified in the perpendicular direction if 

2l3vl > fi> 0. (334) 
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Fig. 48. Solutions of the Egs. 13301 as a function of time for /i = and initial conditions z(0) — u^{0) — 
0.8, corresponding to the region of the attractor of translational motion. Left panel: The translational 
(squared) velocity z{t) — v?{t) approaches slowly the maximal value z — 1. An oscillating contribution 
remains which is due to the neutral stability of the v^{t) - dynamics. Right panel: The longitudinal 
component of the velocity v\\(t) goes quickly to zero and the transversal velocity v±{t) decays very 
slowly or remains constant (because of neutral stability) [98| . 

We see that the alignment increases the stability of parallel motion. These results illuminate 
the role of the velocity couplings. Without the existence of a (positive) velocity coupling, the 
swarms tends to show a weak instability in the transversal direction, i.e. it tends to get broader 
and broader, remaining concentrated around the center of mass in the longitudinal direction. 

Since this mode is oscillatory with frequency ujq wc find small oscillations of the particles 
perpendicularly to the direction of motion. It can be also inspected from left Fig. UB] where the 
particle move with a broadened distribution perpendicular to the center of mass motion. 

Details about the dynamics we may obtain from explicit solutions, for the special set of 
parameters a = /3 = 1. In Fig. 1481 we show several solutions corresponding to initial conditions 
in the attractor region. We see that typically (for different initial conditions within the attractor 
region) the relative velocity perpendicular to the swarm translation v_\_{t) decays very slowly, 
and the relative velocity in the direction of the swam motion W|[ {t) goes to zero in a very fast 
way. The velocity of the center of mass approaches ui < VQa/ /3 in a rather fast way, however the 
state becomes unstable and a slow oscillatory contribution appears. Including a small amount of 
velocity synchronization /i > all oscillatory components in the translational mode are damped 
out in the time 1/^. In the limit case ^ = i.e. no synchronization of the velocities exist. 

Note that the relative velocities wy and v± are defined respectively to the velocity of the 
c.o.m.. Therefore, even if the parallel velocities vanish the oscillations of particle movement are 
also present in the velocities taken respectively to he origin of coordinate. 



6.1.5 Influence of noise on swarms 

Including noise we expect instead of the point attractor at u = vq and the two line attractors - 
the 2 limit cycles in the plane u = - that the dynamic systems forms some distributions around 
the attractors. This will obviously lead to some permanent deviations around the center of mass 
(c.o.m.) and of its velocity. Here we will find estimates of the corresponding distributions. For 
these we will use the approximation of independent dynamics of the velocity components , v± 
and of u. Above wc also found the center of mass velocity distribution in Eg. 13271 with the most 
probable velocity given in Eq. 13281 with 

ai^ a-3l3{vj) - /3{vl). (335) 



This expression as well as Eq. (|327p contain still the unknown constant ai which is determined 
by the distributions of the longitudinal and translational velocities. 
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For the longitudinal fluctuations around the center of mass of the swarm near to the stable 
attractor we get 

+ ujIx\\ = -2aii)|| + V^Cll (0, (336) 

where the noise strength of the relative motion is reduced by factor of two. This follows from the 
correlators formulated above for N = 2. The corresponding stationary Fokker-Planck equation 
is solved by 

1 

D 



Po{x\\,v\\) = Cocxp 



2(11 + ^0^f\ 



(337) 



where Cg is given by the normalization. The dispersion is given by 

D 



{v)c^—. (338) 



The longitudinal dispersion depends on the constant ai which is still to be determined. 

For the fluctuations transversal with respect to the c.o.m. of the swarm the situation is 
more complicated due to the problems with linear stability in the v±— direction. Neglecting 
the correlations with the longitudinal fluctuations {v^\v_i_), which are small we find 

^u_L + uj^x^ = v^[{a ~ai-ii)- P{5vx_f] + (339) 

We remember that ai < a for finite noise. Therefore the first term on the right hand side may 
be positive or negative, depending on the situation. We have to differ between two cases: 

(i) For the stable solution ^ > {a — ai), the term with /3 can be neglected for small velocity 
deviations. We obtain the standard problem of a noisy damped oscillator with the distribution 



Po{x±,v_l) = C exp 

and the dispersion 



1 

D 



(340) 



{vD ^ ^. (341) 

^ 2(/i-a + ai) 2/i ^ ' 

In the present case the fluctuations of V|| and v± are rather small and the translational mode 
is the most favorable one. 

(ii) A different situation is observed in the second case of small (or zero) contribution from 
parallelizing interactions. We consider now the situation fj. < (a — ai) in correspondence with 
the inequality p34p . Then in Eq. (j339p the term with /3 has to be taken in to account and the 
dynamics correspond to a limit cycle, beyond a Hopf-bifurcation. However this limit cycle is 
not a standard one, since (a — ai) > fi requires finite noise, i.e. the amplitude of the limit cycle 
is noise driven. 

We emphasize that the behavior corresponds to active motion of the center of mass sup- 
plemented by a small active oscillatory motion of individual particles relative to the center of 
mass (see Fig. |48)) . 

In order to determine ai, we need to estimate {v'j_). First we remember, that v± is a 
component of the relative velovity vector 6v = (vi — V2)/2. The squared velocity-space diameter 
of the limit cycle in first approximation is given by 2(a — ai — /i)//3. This gives us 

(^'i) - (342) 

The longitudinal p38p and perpendicular dispersions p42[) inserted into Eq. p35[) yield: and 
are connected by the relations 

ai = a h /i. (343) 

2ai 




Fig. 49. Upper row: Snapshots of the swarm configurations in space of coordinates in the translational 
mode u = vo at times t = 100, 100, 1500 for small noise, (parameters loq = 0.01; D = 0.00001; N = 100). 
The straight dotted curve represents the trajectory of the center of mass. Lower row: A time sequence 
{t = 20,80, 110) of swarm configurations in space at larger noise which end in the rotational mode 
(parameters ojq = 0.2; D = 0.001; N = 100). The center of mass becomes eventually resting [95] . 



It is a quadratic equation in ai and has the solution 

(344) 



ai = i(a + /^) 



(a + /i)2 



We see that the dispersion of u^, corresponding to the small oscillating motion in Fig. |48j is 
maximal for the critical noise strength 

{a + i^l)^ 

This is in good agreement with simulation results in }114j . 

We note however that our simulations show that the translational mode occurs to be un- 
stable with respect to fluctuations. We observed that the translational mode for particles with 
harmonic interactions in two dimensions is always a transient state. For sufficiently long simu- 
lation times we found for fi — that even at such small noise a.s D = 0.001 the system switches 
to the rotational mode (see Figs. 1321) • We point out that we never observed transitions from 
the rotational mode back to the translational state of a moving center of mass even within 
extremely long simulation times. 

This underlines the importance of having at least a small contribution of velocity synchro- 
nization /i > 0, which stabilizes the translational mode. In the next Section we will discuss 
bistability between both modes which is due to a hard core potential in three dimensions. Here 
we show frequencies of the center of mass speed, recorded during finite simulation with transla- 
tional mode as initial condition in Fig. 1501 which indicate the transient bistable behavior. The 
amount of probability around the translation and rotational mode clearly depends on the noise 
intensity. 
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In case of simple harmonic forces the probability is distributed around two limit cycles 
corresponding to left or right rotations. These distributions for the rotational mode are similar 
to what we have found for the case of external fields. In the mean field case and with linear 
forces the particles do interact effectively with the resting center of mass, only. In result there 
is no tendency to states where all particles move synchronously along one circle. Such way the 
circles does not behave like attractors for the whole swarm and any decomposition of particles 
with right and left rotations is possible. 




Fig. 50. Relative frequencies /(|w|) of the swarm speed |u| estimated from simulations along finite 
times which have started in the translational mode. Left panel: The translational mode produces for 
small noise D = 0.00001 a narrow maximum near to the maximal velocity of the swarm |u| = vq (here 
vo = 1). Right panel: At larger values of noise D = 0.01 the translational mode broadens and the 
rotational mode dominates. The latter forms forms a big maximum corresponding to more frequent 
rotational configurations [98| . 



Summarizing our findings we may state: For two interacting active particles there exist a 
translational and a rotational mode. In the rotational mode the center of the "dumb-bell" is 
at rest and the system rotates around the center of mass. Only the internal degrees of freedom 
are excited and we observe driven rotations. In the translational mode of the dumb-bell the 
center of mass of the dumb-bell performs an active Brownian motion similar to a free motion 
of the center of mass. In this case we may expect a distribution similar as given j301| . Larger 
noise leads to larger deviations from the center of mass, which finally favors transitions to the 
rotational state. 



6.1.6 Cohesion, repulsion and bistability in 3D swarms 

In this section we present simulations of swarms and their dynamics in three spatial dimensions. 
Wc consider a set of N identical active particles interacting globally via a pair potential as 
outlined in the last section (Sec. 16. 1|) . The coordinates and velocities have now three 
independent components. 

We use a potential which captures fundamental properties of swarming of animals. At short 
range the potential has to be repulsive to avoid collisions and to prevent the agents from 
interpenetrating each other. An attractive force mimics the aim of the individual to stay with 
the group. The attraction should be of long range, but eventually approach zero to account for 
the limited sensing range of animals. An exponentially decaying function meets both demands. 

Therefore we consider here a generalized Morse potential, which consists of an attractive 
and a repulsive part. Both are exponential functions with amplitudes Ca and Cr and ranges la 
and /r, respectively. 

C/^(ri, . . . , r^) Cr cxp (^^^) - ^ cxp (^^-^) • (346) 
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Fig. 51. Rotational (left) and translational (right) mode: Particles move either coherently in a torus 
shape structure or parallel with the moving center of mass (c.o.m.) on a straight line. Parameter values: 
N = 1000, 71 = 1.6, 72 = 0.5, Cr = CsO = Ir = 0.5, L = 2.0, D^O [326] 

The equilibrium distance of two particles is 



For Ir/la < 1 the potential possesses a minimum corresponding to short range repulsion and 
long range attraction. One can see that for Ir/la < 1 and Ir/la > Cr/Ca the minimum would 
shift to negative values. Since the absolute value of the interparticle distance in Eq. 13461 is 
positive, the potential is attractive everywhere. Therefore we will concentrate on the parameter 
space where Ir/la < 1 and Ir/la < Cr/Ca- 

The self-organized rotational dynamics of a Hamiltonian system of active particles with such 
a pairwise Morse potential have been studied by Levine et. al [210] and d'Orsogna et. al [84]. 
Here, we will show that in three dimensions swarms of active Brownian particles interacting 
via Morse potentials with repulsion and attraction exhibit noise-induced transitions not only 
from translation to rotation, as in the purely attractive (harmonic) case, but also the reverse 
transition. These transitions occur at different noise intensities, thus leading to a hysteresis 
curve. This effect was not observed in two dimensions, here the rotation was stable even without 
noise. For comparison we also investigate the harmonic forces as introduced above in three 
dimensions. 

To study the transition from translation to rotation we prepare the system in the trans- 
lational mode (Fig. 1511 right). In this mode the particles move parallel with their stationary 

velocity vq = The spatial configuration in the center of mass system corresponds to the 



equilibrium configuration. Without noise, there are no fluctuations, the center of mass moves 
with Vq. Increasing the noise gives rise to fluctuations and leads to a decreasing velocity of the 
center of mass [2321114] . Above a critical noise value D^lf^^ the translational motion breaks 
down and the particles start to rotate around the center of mass. 

Whereas for a harmonic potential the particles rotate in any direction on the equipotcntial 
sphere, the Morse interaction leads to coherent motion in a torus shape structure, with the 
orientation depending on the initial conditions (Fig. I5ip . The center of mass moves diffusively, 
therefore the absolute value of its velocity is not zero and increases with the noise intensity. 

Starting from the rotational state and decreasing the noise intensity, the system exhibits 
a transition to the translational mode at a different critical noise value i^criV Surprisingly, 
this second transition back to translation was not observed in the two-dimensional case with 
harmonic attraction. In general, both transitions occur at different noise values which leads to 
a hysteresis curve (Fig. [S21 left). 




(347) 
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The decrease of the center of mass velocity with rising noise intensity can be shown by con- 
sidering the equation of motion of the center of mass velocity. The analysis in three dimensions 
develops quite similar to the last Section following Eq. (|322p |326] . One solution corresponds to 
the rotational state, the second solution to the translational state. The center of mass moves 

(in absence of noise) with the stationary velocity of the particles uq = Increasing the noise 

leads to higher deviations Sv which decreases the center of mass velocity. 

For the transition from rotation to translation the critical noise value decreases with increas- 
ing Cr/Ca- However, for Ir/la < Cr/Ca < 1 the critical noise value decreases with decreasing 
below Cr/Ca = Ir/la, HO transition to translation takes place. In this parameter range the 
potential does not possess a minimum, i.e. it does not have a repulsive core and is continuously 
attractive for all distances. Even without noise there is no transition from rotation to transla- 
tion. Otherwise the transition backwards stays unaffected. From this fact we conclude that the 
existence of repulsive forces induces transitions from rotation to translation. 
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Fig. 52. Left panel: Hysteresis of the of the center of mass speed u versus noise intensity D. Solid lines 
for increasing noise and dashed lines for decreasing D. The most probable values for Morse potential 
(red) and its harmonic approximation (not shown) are comparable and show instability of the rotational 
state below a critical noise intensity. For harmonic potential, or Morse potential without a minimum at 
finite distance, only transitions from translation to rotation can be observed. The latter is stable even 
without noise. Right panel: Example of a trajectory of the center of mass in the bistable regime. The 
inlay shows the corresponding velocity. The rotational modes, where the velocity is almost zero, are 
highlighted red. These lead to a diffusive motion of the center of mass within the red circles. In between 
the system displays a stochastic trajectory in the translational mode with mean velocity u '■ 



Vo 



To check this hypothesis, we approximate the Morse potential by a harmonic potential with 
equilibrium distance of the shape 



C/app(r) -a(r-ro)2, (348) 



with 



(349) 



and ro given in Eg. 13471 We compare it to the overall attractive harmonic potential U^.i'T') = ar^ 
(see Fig.jSU left inset). The critical noise value for the transition from translation to rotation is 
equal for the Morse potential and the harmonic approximation (not shown). The translational 
mode of the harmonic potential Un is stable for larger noise values. The main difference occurs 
in the transition from rotation to translation. The harmonic approximation J7app shows this 
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Fig. 53. Probability distribution of the speed of center of mass for different noise values of a swarm 
in 3D with Morse interaction [326) . 

transition, though at a different noise value than the Morse potential. In case of the harmonic 
potential without repulsive part Un the rotational mode is stable even without noise. This 
supports the assumption, that a short-range repulsive part of the potential is vital for the 
existence of the transition from rotation to translation. 

For both transitions we observe the critical noise value to decrease with increasing amplitude 
of the repulsive part of the interaction potential Cr- Yet, the decrease is much faster for the 
transition from translation to rotation which leads to a parameter region where transitions in 
both directions occur at the same noise value. 

In this region, the system alternates between the two states. The inlay of the right panel in 
Fig. [55] shows the center of mass velocity u which alternates between translation and rotation 
(red). The trajectory of the center of mass shows diffusive motion, where the system is rotating, 
separated by parts with stochastic translational motion fFig. I521 right panel). 

The probability distribution of u depends very sensitively on the noise intensity (Fig. [5^ . 
The region where this oscillatory behavior can be observed is very small. Changing the noise 
value by a few percent leads to a shift of the transition probabilities which is sufficient to destroy 
the oscillations. It is sketched in Fig. [S3] where for both graphs the noise intensity has changed 
little. Nevertheless, the weights of the two states in the two distribution changes drastically. 



6.2 Collective motion from local velocity alignment without cohesion 

6.2.1 Interactions of active particles mechanisms and symmetries 

Active matter may be more generally divided into in externally driven particles, e. g. shaken 
granular matter, and in particles which are intrinsically powered, self-propelled particles, like 
gliding and swarming cells, or chemically active particles, e.g. oscillating yeast cells. Self- 
propelled particles are almost always polar, as their propulsion mechanism determines typically 
their direction of motion, or, more specifically the leading and trailing edge of the particle are 
clearly distinguishable (see also Sec. 12.31 and 13. 1|) . This requires an initial symmetric breaking 
in the internal structure of the self-propelled particle, e. g. polarization of motile biological cells 
or asymmetric design of manufactured granular particles under driving. Examples are driven 
granular particles with non- symmetric shape or mass distribution [202 201 80] or different 
chemical composition at the two ends of a particle, like chemically driven running droplets or 
nano-dimers (Janus particles) j260l328l295l335l345l349| . To understand the collective dynamics 
of ensembles of active particles, one needs also to figure out the nature of their interactions. 
Swimming bacteria, fiocking birds and schools of fish are often assumed to have hydrodynamic 
interactions that favor a joint direction of motioir. Such interactions are analogous to ferromag- 
netic interactions of spins and try to align the vectors describing the motion of the particles; 
consequently, one speaks of polar interactions. In contrast, gliding bacteria or shaken rods 
tend to align their long axes, but still can either move in a parallel or anti-parallel fashion. 
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Hence, such interactions are classified as apolar. Apolar interactions are analogous to ncmatic 
interactions that favor alignment, e. g. excluded volume interactions of rod-shaped particles. 

The famous Vicsek model represents an example for polar particles exhibiting polar inter- 
actions |354j . Self-propelled rods with volume-exclusion interactions can be identified as polar 
particles with apolar interactions. The so-called active nematics constitute a third case, namely 
apolar particles with apolar interactions, that shall not be discussed here. For recent results on 
active nematics |343| , such as the analysis of a simple Vicsek- type model |60j and experiments 
with externally driven elongated particles such as rice corns, see instead e.g. |243I13I244] and 
references therein. 

A central question in the study of such active particles with local interactions is if and when 
long-range order arises. The nature of the transition between ordered and disordered types of 
motion has been investigated thoroughly. Below, we will discuss several mean-field theories that 
neglect spatial variation in the order parameter. For the Vicsek model, the mean-field theory 
predict a continuous second order phase transition to long-range order, which was reported 
initially also in numerical simulation [354173] . Gregoire and Chate later found in extensive 
simulations that the transition to collective motion in the Vicsek model appeared in fact in 
a discontinuous way provided the system size in the simulations is large enough |142j . Their 
result was contested by later results of Vicseks group j242] . but recent even more extensive 
studies by Chate, Ginelli et al. reaffirm the discontinuous nature of the transition at the onset 
of collective motion |59j . This work revealed a crossover from a second to a first order transition 
at sufficiently large system size, which can depend strongly on the velocity parameter used in 
the simulations. More importantly, their work showed that the appearance of a discontinuous 
transition is strongly correlated with the appearance of segregation bands of high particle 
density in a low density background that travel in the direction motion of the self-propelled 
particles in these bands. Such correlations between the transition behavior and spatial patterns 
of the particle density shall be left aside for the moment and will be treated in Section [7] that 
deals with pattern formation aspects of self-propelled particle systems. An important general 
lesson is that spatial aspects maybe crucial and need consideration. For the moment, we will 
however exclude them and leave their general discussion to Section [T] In the following, we 
proceed with the discussion of local polar (or ferromagnetic) alignment of active Brownian 
particles, before considering both polar and apolar alignment interactions in the framework of 
self-propelled particles with Vicsek-type dynamics. 

6.2.2 Active Brownian particles with velocity alignment force 

We consider now a system of N active Brownian particle interacting only via a local velocity 
alignment force F™ (see Eq. [3201 |72I247I291I^ ). which may be written as 

Fr = MKe-vO (350) 

with Ui_£ being the mean velocity of the particle gas within within a finite distance jr-,- — r^j < e 
around the focal particle i {i = 1, . . . ,N). The force aligns the velocity of the focal particle 
to the average local velocity with /i being the alignment strength, which corresponds in the 
deterministic case to the inverse relaxation time of towards u^^^. For solitary particles with 
no neighbors or a system in a perfectly ordered state where all particles move with equal velocity 
the alignment force vanishes as ^ = v^. On the other hand for a large number of neighbors 
moving with random velocities (disordered state), the mean velocity vanishes \u^.i\ = u^,i ~ 
and the velocity alignment force results in additional "social" friction The force may 

be considered as a continuous version of the Vicsek model and for self-propelled particles with 
constant velocity Vi = const it reduces essentially to the polar alignment interaction discussed 
in the next section |267| . Another motivation for introduction of such an velocity alignment 
term comes from hydrodynamic interaction which may result in an alignment term with similar 
symmetry properties |llll23j . 

Recently, there has been a number of publication on kinetic description of self-propelled 
particles with velocity alignment (see e.g. |342I341I35I317I318I208IT7T] . see also Sec. EI]). In 



106 



Will be inserted by the editor 



these previous publications, the authors constructed mesoscopic equations of motion for the 
density and velocity fields using symmetry and conservation laws. Recently, |35j derived corre- 
sponding equations with a Boltzmann approach. Further contributions were made by C.-F. Lee 
[208j , who studied collective dynamics due to velocity alignment by analyzing an approximated 
Fokker-Planck equation and by T. Ihle |171| who derived an Enskog-type kinetic theory for the 
Vicsek model. 

Here, in contrast to the previous publications, we derive the mean field equations directly 
from the microscopic Langevin equations. We do not assume a constant speed and analyze the 
impact of the velocity-dependent friction function on the onset of collective motion. In addition 
to the density and velocity fields, we consider explicitly the effective temperature field of the 
active Brownian particle gas. 

Our approach is based on the formulation of moment equations of the corresponding proba- 
bility distribution. In general, far from equilibrium the probability distributions are not Gaus- 
sian and a correct description requires infinitely many moments (see for example |258l259j ). 
Therefore approximations are necessary in order to obtain a closure of the system of moment 
equations. 

As first example we consider a one-dimensional system with periodic boundary conditions 
(d ~ 1, one-dimensional ring). The n-th moments of the velocity (v") is defined as 

(v'') = - [ v"i}(x,v,t)dv, n>0, (351) 
P J 

where '4>{x^v^t) is the one particle distribution describing the probability to find a particle at 
time t, at position x moving with velocity v. For N identical particles it is given by simply 

by the multiple of single particle probability density tp{x,v,t) = NP{x,v,t) The density of 
particles is given as 

p{x,t) — J dv ^{x,v,t)dv — N J dvp{x,v,t). (352) 

Multiplying the n-th moment with the density and taking the derivative with respect to time, 
we obtain the dynamics of the moments of velocity 

|(p(^"» = /«"frf^. (353) 

The equations of motion for active Brownian particles with Rayleigh-Helmholtz friction and 
velocity alignment read: 

Xi = Vx,i (354) 
Vx^t (a - f3vi)vx,i + ti{u^.i - Vx,i) + (355) 

The Fokker-Planck equation for a single particle in the mean velocity field reads 

BP 3 3 3"^ 

Here we omit the index i for simplicity. The velocity ~ Ui;{x,t) is the mean field velocity 
sensed by the particle. In the continuous description we may express it as an integral over the 
distribution function: 

dx' / dv'v'^{x' ,v' ,t) (357) 



Js^p{x',t)dx' ^ 

Here represents the spatial neighborhood of the focal particle, which is defined via a metric 
distance: x G ii \x' — x\ < e. In the limit e — )■ together with — )■ oo, reduces exactly to 
the first velocity moment (v) psip , whereas for finite e it may be seen as an approximation of the 
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first moment under the assumption of a homogeneous density distribution on the corresponding 
length scale. 

Inserting Eq. (|356|) in to Eq. p53p and using limi,_j.-|-oo Pi^, v, t) = 0, the terms with partial 
derivatives with respect to v can be partially integrated, yielding 

+ n(n- 1) Dp {v"-^). (358) 

We rewrite the velocity of the focal particle as a sum of the local velocity field u{x, t) plus some 
deviation 5v: v = u-\-5v. Furthermore, we assume (^i;') = for odd exponents / (Z = 1, 3, 5, . . . ). 
Thus we obtain for the moments (up to I = A): 

{v) = u , (359a) 

(v^) =u^ + T , (359b) 

(v^) ^u^ + 3uT , (359c) 

{v'^) ^ u-^ + 6 T + + e . (359d) 

Here, T is the mean squared velocity deviation T = {Sv"^), which we will refer to as the "tem- 
perature" of the active particle gas, whereas 6 is the average of the mean squared temperature 
fluctuations defined as 



9^{(^iv-uf^Ty)^{6v^)~T^. (360) 

Now we can insert Eqs. (|359p into Eq. (|358p . Considering the dynamics up to n = 2, after some 
calculus we arrive at a set of three coupled partial differential equations for the evolution of the 
density p{x,t), the mean velocity field u(x,t), and the temperature field T(x,t): 

lp = -^ipu) (361a) 

, ^ R ( 2 , nrj.\ , f dT T dp 

— + u —u = a u — p u [u + 61 ) + piu^ — u) — — (361b) 

ot ox ox p ox 



Let us consider for simplicity an isotropic system with vanishing gradients in mean velocity 
u and temperature T, which is fully analytically tractable and represents a reasonable approx- 
imation of the system dynamics at high particle densities and large e. In this case, the local 
velocity in the velocity alignment force equals the constant mean velocity field across the system 
Ug = u, and we end up with the following two ordinary differential equations for the temporal 
evolution of u and T: 

^ =a u- l3 u (u^ -f 3T) (362a) 
=(a - Ai) T - /3 T (3^2 +T) - (39 + D. (362b) 

In order to obtain a closed system of equations, we neglect the temperature fluctuations by 
setting ^ = in Eq. p60[) . which is a reasonable assumption at small noise intensities. Thus, 
the above differential equations constitute a two-dimensional dynamical system, with 6 fixed 
points (stationary solutions) in the (m, T) phase space, which can be analyzed by means of 
linear stability analysis. 
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Fig. 54. Bifurcation diagram of the mean velocity u vs noise intensity D as predicted from the mean 
field theory for different velocity alignment strengths (a = /3 = 1) : (a) < 2a/3 {n = 0.1), (b) 
2a/3 < fj. < lOa/3 (/i = 0.7) and (c) /j. > lOa/3 (/i = 5.0). (d) Phase diagram with respect to velocity 
alignment /i and noise intensity D [291) . 



The stationary solutions {du/dt = dT/dt = 0) for u and T read: 



Ml, 2 = 0, 



M3,4 = ± 



Ms, 6 = ± 



v/lOa - 3 (Ai - Z\) 
V'lOa - 3 (Ai + zi) 



7^3,4 
75,6 



Tl,2 = 



2/3 



2Q! + /.t - /\ 
16^5 

2a + ^ + A 



(363a) 
(363b) 
(363c) 



with A = ^{2a + nf - 

The kinetic temperature Tj has to be positive, therefore, Ti (positive square root) is the 
only physically reasonable solution for u ~ 0. 

The first solution with vanishing mean velocity u = describes a disordered phase. For 
D ~ 0, the temperature T = = equals the square of the stationary velocity of indi- 
vidual particles. The kinetic energy of all particles consists only of fluctuations, no systematic 
translational motion occurs. The second pair of solutions corresponds to translational modes 
which are stable below a critical noise intensity. The two solutions correspond to translational 
motion with positive or negative velocity u, thus, to a collective motion of the particles to the left 
or right. Without noise, T3.4 = 0, and the stationary mean velocity reduces to U3.4 — -^^foLlfi. 
Increasing the noise rises the kinetic temperature, and results in a decrease of the mean speed 

The last solution pair describes unstable modes, for which the temperature decreases and the 
mean speed increases with increasing noise intensity D. 

For low alignment strength \Jl < 2a/3, the disordered phase is always a stable solution; for 
fi > 2a/ 3, the linear stability analysis of the mean-field equations predicts the existence of a 
critical noise intensity 

a{3^ — 2a) 



c/,crit 



9/3 



(364) 



which determines the stability boundary of the disordered solution. Starting from large noise 
intensities where the disordered solution is stable and decreasing the noise below Dd.mt, we 
observe a pitchfork-bifurcation, and the disordered phase becomes unstable. Depending on 
the value of /i, the pitchfork-bifurcation is either sub- or super-critical. For /i < lOa/3, the 
disordered solution becomes unstable through a collision with the two unstable translational 
solutions, whereas for ^ > lOa/3 no unstable translational solutions exist and the disordered 
solution becomes unstable directly through the appearance of the two stable translational so- 
lutions (see Fig. [S3]). Thus, for fi > 2a/3 and D < -Dd.crit, only the translational solutions ^3^4 
are stable. 
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Fig. 55. (Color online) Comparison of the stationary solution obtained from simulation with theoretical 
prediction from the mean field theory for different velocity alignment strengths: /i = 0.4 (a), = 0.67 
(b) and /i — 5.0 (c). Other parameters used: particle number A'^ = 8192, simulation domain L — 500, 
velocity alignment range e = 50 and a, /3 = 1.0. The initial conditions were either the disordered state 
(black filled squares) or the ordered state (red circles). Solid (dashed) lines show the stable (unstable) 
stationary solutions of the mean-field equations |291| . 



For fi < 10a/ 3 there exists a second critical noise intensity which determines the stability 
of the ordered phase (translational solutions, u ^ 0). Above the critical noise intensity 

all translational solutions become unstable through a saddle- node bifurcation (Fig. [54] a,b) . 

Due to the symmetry of the translational solutions U3 = — U4, wc may distinguish the 
disordered phase and the ordered (translational) phase in simulations by measuring the global 
mean speed in our simulations: 



1 ^ 



i=l 



(366) 



Here, (•) denotes temporal average after the system has reached a stationary state. 

The stationary speed of the ordered phase versus noise intensity obtained from numerical 
simulations with ordered state as initial condition are in a good agreement with the theoretical 
predictions from the mean field theory. But simulations with disordered initial condition reveal 
an unexpected instability of the disordered solution. At finite ji the numerical simulations show 
that at intermediate D the disordered solution u = becomes unstable via a spontaneous 
symmetry breaking, which is not predicted by the mean field theory. 

We reproduced the instability of the disordered solution in numerical simulations for inter- 
mediate noise strengths for different particle numbers and for global coupling (e — L). This 
suggests that it cannot be simply dismissed as a pure finite size effect or an effect of density 
fiuctuations and should be associated with the neglected higher order fluctuations. The latter 
conclusion is supported by the agreement of the theoretical result and numerics at low D, where 
temperature fiuctuations 9 are negligible, as well as with deviations of the mean field temper- 
ature from the exact solution for T in the limit ^ = Q |116I291| . Due to the nonlinearity of the 
friction function, the temperature does not increase monotonically with D as predicted by the 
mean field theory but exhibits a minimum at intermediate noise intensities [291j . This in turn 
has a destabilizing effect on the disordered state. Therefore we expect that the extension of the 
mean field theory to higher orders would account for this effect at the expense of the analytical 
tractability of the mean field solutions |110j . 

The same approach can be also extended to two dimensional systems where the mean field 
velocity and temperature are vectors: u = {ux,Uy) = {{vx), (vy)), T = [T^.Ty) = {{SvD, {Svy)). 
Under the assumption of independent deviations in x and y-direction {Sv^Sv"^) = ((5w")((5w™) 
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we can derive the following set of mean field equations: 

d 



^^p = -V{pu) (367a) 



dt 



1 fdT^ 

2 I dt 



■f uVrMx = aux - pUx (u^ + iTx + Ty) + n{us^x - Ux) 

_dTx_Tx dp 
dx p dx 

uV,.rJ = (a - p)Tx - pXx (u2 + 2ul + T, + 7:^) - /3( 



(367b) 



D-Tx^. (367c) 
ax 



The corresponding equations for Uy and Ty can be obtained by interchanging the indices. We can 
further simplify the above set of equations by choosing a reference frame, where Ux = U|| = u 
corresponds to the mean field velocity and the orthogonal component vanishes Uy — uj_ ~ 0. 

Assuming again the simplest case of a spatially homogeneous system, we obtain the following 
set of coupled (ordinary) differential equations: 

^ =au ~ Pu {u^ + 3T|| + Tl) (368a) 

=(a - p)T\\ - I3T\\ (3u2 + T\\ +T±)+D (368b) 

=(a - - f3T^ {u^ + Til +Tj_)+D (368c) 

where Ty and T± are the temperature components parallel and perpendicular to the mean field 
direction of motion. For u = (disordered state) the components on T can be easily calculated 
from p68p and the corresponding solution reads: 

ui =0 (369a) 



Ti\,i = T±.i = Ti = (369b) 

In the case of vanishing noise D = the ordered solution can be immediately obtained as 
u = \J Q-l ii and Tj| = Tl = 0. For > the temperature component parallel to the direction 
of motion is smaller than the perpendicular one: < T±. 

For the general ordered state with m > and I? > we were not able to obtain explicit 
stationary solution for u, Tji and T± of the above ODE system p68p but the stable and unstable 
solutions can be determined by a numerical continuation methods as for example provided by 
the numerical software XPPAUT/AUTO |82I117| . 

A possible approach to find an explicit solution is to reduce the dimensionality of the 
problem. We may use the fact that at a fixed time t we always find a coordinate frame where 
Ux = Uy = u. In this coordinate frame due to the symmetry of the involved equations we obtain 



also Tx ~ Ty ^ T. Based on this observation we reduce the full problem p67|) from a four 
dimensional system to a two dimensional system in u and T, which in the homogeneous case 
simplifies to 



du 

— ~au 
dt 



1 dT 
2~dt 



Pu(2u^ + Afj , (370a) 
--{a - p)f - pf [au^ + 2fj + D. (370b) 



This gives us a system of equations similar to the problem for d ~ 1, with the same structure 
of stationary solutions but different coefficients. 
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Fig. 56. Comparison of the mean field speed \u\ obtained from Langevin simulations (symbols) of the 
RH-model in two spatial dimensions at high density with the results of the mean field theory for the 
homogeneous case. The black lines represent the solutions obtained from the full system of mean field 
ODE's. The red lines represent the mean field solutions from the reduced system. The stable solutions 
are shown as solid lines, whereas dashed lines indicate the unstable solution. The simulations were 
performed with periodic boundary condition and with the disordered state as initial condition. Other 
parameters; a = 1, /3 = 1, L = 200, e = 20, iV = 4096 [294] . 



The comparison of the stationary solutions of the redueed systems with the corresponding 
solutions of the full systems obtained with XPPAUT/AUTO reveals a differences at low velocity 
alignment strengths /i (Fig. [56]). The velocity of the stable ordered solution of the full system 
decreases stronger and exhibits an earlier breakdown with increasing D. Furthermore from the 
position of the disordered branch it can be deduced that the basin of attraction of the ordered 
state at low D for the full system is larger than for the reduced two dimensional system. But 
at large /.t the differences between the two types of mean field solution vanish and the reduced 
system p70p gives a good approximation as shown in Fig. 1561 

The reason for the discrepancy between the two mean field solutions at low /i is that the 
performed dimensional reduction throws away all informations about the asymmetry of temper- 
ature components parallel and perpendicular to the mean velocity. At large ^ the evolution of 
the temperature coefficients is dominated by the —fiTk term and may in a crude approximation 
simply be assumed as linear for both components, so that the asymmetry in the temperature 
components can be neglected. 

In general without knowing the temperatures Tn and T± the mean speed, can be written as 

\u\ = ^vl-iT\\-T^ (371) 

where Wq = a//3. In the limit of large /i close to the critical noise, where a, /3 ^ Z? we may 
approximate the temperature as T|| = Tl = T = D/fi and obtain a simple expression for the 
ordered state 




(372) 



In this limit the critical noise may be approximated as -Dd,crit ~ ^^o/^/4 — Dait and the above 
equation may be rewritten as: 

\u\ = 2fi-^D,,it-D)^, (373) 

which is the standard form of the order parameter for a continuous (second order) phase tran- 
sition. A similar result can be also obtained for self-propelled particles with constant velocity 
[267) . corresponding to the limit a, /3 — > cx) with a/l3 = Vq = const, with Ty = and T± = D/fj,. 
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Fig. 57. Illustration of nematic LC-alignment of polar self-propelled particles illustrated by inelastic 
collisions of rods. Particles incoming at a small angle (left) align "polarly" , but those colliding almost 
head-on slide past each other, maintaining their nematic alignment (right). 



The mean-field theory, suggest the possibility of a discontinuous transition from ordered to 
disordered state (saddle-nodc bifurcation) as a consequence of a nonlinear friction function at 
intermediate alignment strenghts. However, for limiting cases, where the nonlinear nature of the 
friction function is negligible, e.g. for vanishing velocity fluctuations (see next section) or strong 
velocity alignment, the transition in a homogeneous system is a continuous one. We should note 
that for very small alignment strengths /i the critical noise intensity becomes also very small. 
In this limit, for arbitrary friction functions, the small passive fluctuation act essentially only 
on the direction of motion and the speed of individual particles may be assumed as constant. 
Thus, in this case, the collective mean-fleld dynamics reduce effectively to a Kuramoto-model 
of coupled oscillators, which also shows a continuous transition from order (synchronized state) 
to disorder. 

Recently, it was shown that the spatially homogeneous state is unstable in systems of in- 
teracting self-propelled particles |35I317I3I5] . Thus, the assumption of a spatially homogeneity 
should be considered only as an approximation, for sufficiently large e. For L 3> e strong den- 
sity inhomogeneities appear, such as traveling bands, which affect the global behavior of the 
system |59I37I23^ . A detailed discussion of the spatial inhomogeneities in self-propelled particle 
systems will follow in Sec. [T] 

In contrast to d = 1 no stable disordered solutions at low fi and low noise intensities D 
were observed (Fig. [55| . A possible explanation can be the reduced basin of attraction of the 
disordered solution for d = 2 together with the already discussed instability of the disordered 
solution due to the neglected temperature fluctuations 9k observed already for d = 1. 

A more heuristic explanation for the instability of the disordered solution in two spatial 
dimensions for low /i and low D, in contrast to the one-dimensional case, is the absence of a 
velocity potential barrier between different direction of motion: In two dimensions the particles 
can change their direction of motion by continuous angular drift or diffusion. Thus, any small 
fluctuation in u in a flnite system at vanishing noise {D <C 1) will be amplified and eventually 
will lead to perfect velocity alignment. 



6.2.3 Mean-field theory for onset of polar and nematic order 

The Vicsek-model |354| is considered the simplest model for collective motion of self-propelled 
particles (SPPs). It has become quite popular because it is computationally much more efficient 
than many other models for collective motion of active particles. In the Vicsek model, point-like 
particles moving with a velocity vector of constant magnitude interact by aligning their velocity 
direction to the local average velocity. The Vicsek model can be considered as a model of moving 
spins, in which the velocity of the particles is given by the spin- vector. Extending this analogy 
with spin systems we denote this polar alignment mechanism as ferromagnetic (F-alignment). 
Initial simulations of the Vicsek model in 2D seemed to indicate a second-order phase transition 
which leads to long-range orientational order in collectively moving SPPs [354l242j . Later work 
pointed towards a first order phase transition to orientational order in sufficiently large systems 
|59j . Theoretical interest was stirred by the that fact that in analogous equilibrium systems of 
non- moving spins no long-range order is possible |228ll96j . 

F-alignment is one possible alignment mechanism, but clearly not the only one. If a system 
of e. g. self-propelled rods interacts simply by volume exclusion, particles may end up moving 
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Fig. 58. Temporal evolution of the velocity direction distribution (angular distribution) in simulations 
of self-propelled particles with very fast angular relaxation, where (a) corresponds to the case F- 
alignment (Vicsek-model), while (b) shows the case of LC-alignment (Peruani model). Number of 
particles = 100, radius of interaction e = 2, linear system size L = 42.4, and noise amplitude 



in the same direction as well as in opposite directions. Such an apolar interaction mechanism 
corresponds to interactions in liquid crystals where apolar particles get locally aligned j83| . 
In analogy to these systems we name this mechanism hence liquid crystal alignment (LC- 
alignment). An graphical illustration for LC-alignment is given in Fig.[57l In a system of SPPs 
with LC-alignment particles align their velocity to the local average director. Orientational 
order observed in simulations with SPPs with LC-alignment refers to the emergence of a global 
director in the system, while for F-alignment orientational order refers to the appearance of 
a global direction of motion. In the following, two alternative continuum models for SPPs 
with polar, ferromagnetic resp. apolar, liquid-crystal like interaction will be introduced and 
compared to the Vicsek model and a recent variation |267I136] with LC-alignment interactions, 
the Peruani model. For the continuum version of the SPP models with local ferromagnetic resp. 
liquid crystal alignment a mean-field theory describing the onset of collective motion is derived 
and compared to simulation results obtained with the Vicsek model. 

We consider point-like particles moving at constant speed in two dimensions and assume an 
over- damped situation such that the state of particle i at time t is given by its position and 
its direction of motion ipi. The evolution of these quantities follow: 



where 7 is a relaxation constant, and U the interaction potential between particles, and hence 
■^^{vi, ipi) defines the velocity alignment mechanism. Moreover, vq represents the active con- 
stant speed of the particles, the unit vector e^iipi) is again defined as e^iifii) = {cos{ipi) , si'a{ipi)) , 
and fji{t) is an additive white noise. In the sense of Sec. 13. 2[ it is an active noise acting per- 
pendicular to the direction of motion. Eqs. p74p and p75p are expressed in terms of first 
derivatives. In this way, vq in Eq. p74p can be considered as an active force divided by a trans- 
lational friction coefficient. In analogy to spin systems, the ferromagnetic velocity alignment 
mechanism is given by a potential defined as: 



ri = 0.25. 



= -l-^iji,(p,) +T]i{t) 



(374) 



(375) 



'i 




(376) 



where e is the radius of interaction of the particles. For the liquid-crystal alignment mechanism, 
we choose the potential originally introduced by Lebwohl and Lasher on a lattice [207] which 
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reads: 



ULcir^,(Pi) = ~ cos^i^i-^j) (377) 

|r.-r,|<e 



One can add a coupling strength coefficient to tire expressions p76p and ([377]). We assume that 
the coupling strength is absorbed in 7 in Eq. ([375]). Notice that the potential given by Eq. (|376p 
exhibits one minimum, while Eq. (j377|) has two minima, which correspond to particles pointing 
in the same direction and particles pointing in opposite directions. 

In the limiting case of very fast angular relaxation we obtain from Eqs. (|374p and p75p the 
updating rules: 

r*+^*=r* + «oev(^n^t (378) 



t+At _ 



arg V f(ev(^),ev(^*)) +,7,(i) (379) 



where arg (b) indicates the angle of the vector b in polar coordinates, rjl is the random increment 
of the angle in the interval At comparable to a Wiener Process and giving rise to angular 
diffusion (see Sec. I3.1.i]) . The noise sources are statistically independent for different particles. 
In simulations we have used equally distributed random numbers from rji(t)e fP' "^^^ 
term f(a, b) describes the interactions and is defined as follows. For F-alignment, f(a, b) = a 
and Eqs. (|378p and (|379p correspond to the Vicsck model [354] . For LC-alignment, f takes the 
form: 

This interaction was introduced by Peruani et. al.. Hence we will refer to the corresponding 
model (Eqs. 13781 13791 1380p as the Peruani model. To decide if the described local alignment 
mechanism give rise to global order, suitable order parameters have to be defined. One such 
order parameter that quantifies the direction of alignment and collective motion is the modulus 
of the normalized total momentum (analogous to the magnetization in the XY- model [2281196] ). 
that we express as: 



N 



1=0 



(381) 



where N stands for the total number of particles in the system. The quantity has the value 
1 when all particle move in the same direction (perfect F- alignment). In contrast. is equal 
to in the disordered case in which particles point in any direction with equal probability. An 
alternative measure for collective motion is the velocity direction distribution in two dimensions 
C{(p). For high values of the noise, C{(p) is flat. When the noise is decreased below a critical 
noise ijc, a single peak arises in C{(p) indicating the onset of orientational order, see Fig. [SSJ^a). 

On the other hand, for perfect nematic order or LC-alignment, i. e. half of all particles 
move in one direction, and the other half in the opposite direction, is identical zero. Clearly, 

cannot distinguish between a state of LC-alignment and a disordered state. To study such 
LC orientational ordering, one can employ the order matrix Q of liquid crystals |83] . For two 
dimensions one takes the largest eigenvalue S^'~^ of Q as appropriate order parameter: 



j^*^ = - + - 
4 2 




} (382) 



^ Variation of the temporal interval At implies a scaling of 77 with the interval. For the case of white 
noise in Eq. (|374[) the variance of rii{t) increases linearly At. 
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where Vxi and Vyi are defined as Vxi — cos{(pi) and Vyi ~ sm{(pi). The order parameter S^'~^ takes 
the value 1 when all particles are aligned along the same director, and the value ^ in a disordered 
phase without any preferred orientation. Alternatively, the velocity direction distribution C{ip) 
can be considered. This function displays two peaks separated by tt for simulations of the 
Peruani model low noise amplitudes, see Fig. ISST b'). 

A system of SPPs may be conveniently described through the one particle density in the 
phase space ip{r,v,t) — ip{r,(p,t) which equals the one particle probability density function 
P(r, V, t) multiplied by the particles number N. Then the usual particle density at a point r is 
obtained as 

pir,t) = I ^ir,if,t)dip. (383) 







For simplicity, we consider the angular velocity direction distribution: 

C(^,i)= / i'{r,V>,t)dr (384) 



and neglect spatial inhomogeneities in the orientation of the particles. We recall that in the 
individual-based model the kinetic energy is conserved, while the momentum is not. For F- 
alignment, the system tends to increase the total momentum, while for LC-alignment the ten- 
dency is to decrease it. The continuum approach has to reflect that particles always move at 
constant speed and that number of particles is conserved. 

Consequently, the following evolution equation for 'ip{r,ip,t) is obtained: 

9tV' = D^d^^ij} - - Vr [urV'] , (385) 

where u^pip and Ur'0 are deterministic fluxes, which reflect the local alignment mechanism 
and active motion. The quantity refers to the angular diffusion whereby we have assumed 
Gaussian noise in Eq. p75p . It depends on the square of the noise amplitude. The term M(^(r, ip) 
describes mean angle velocity of the alignment interactions of particles with all neighboring 
particles which are at a distance less than e from their location r. It reads 

^ -J J dv' J dip'^^^^^^^^^^i;ir\ip',t) (386) 

R(r) 

where U{r,(p,r' ,Lp') represents the pair potential between a particle located at r and pointing 
in direction ip with another one at r' and pointing in direction ip' . R{r) denotes the interaction 
neighborhood. The above models have the property U{r,ip,r' ,ip') = U{ip,(p')^ i. e. within the 
interaction radius the potential between particles has equal strength and is homogeneous in 
space. Finally, represents the "torque" felt by a particle located at r and pointing in direction 
tp. The expression for u^. simply reads 

Ur = voev(v?)- (387) 

Integrating both sides of Eq. (|385p over the space f2 and assuming a homogeneous spatial 
distribution of particles ip{r,p,t) = C{p,t)pf)/N, where po is defined as po = N/L"^ and L is 
the linear size of the system, we obtain an evolution equation for C{p,t): 

dC{p,t) d^Cip,t) 

-J-Ju 



dt ^ dp^ 



^'dp''-^^C[p'.t))C[p,t) 



(388) 
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Fig. 59. Temporal evolution of C{tp,t). (top) F-alignment, numerical integration of Eq. (|389|) with 
-D^ = 0.28. (bottom) LC-alignment, numerical integration of Eq. (|393|l with = 0.014. For both, 
C* = 0.3183, At = 0.001 and Atp = 0.16. The initial condition is a random perturbation around C* . 
Notice that for F-alignment a single peak emerges, while for LC-alignment the distribution develops 
two peaks. [267] 



The homogeneous angular distribution is a steady state of Eq. ([388]). The parameters for the 
onset of the orientational order and collective motion can be found by determining the linear in- 
stability of the disordered state. We start by analyzing the case of F-alignment. By dividing both 
sides of Eq. (|388p by 77re^/L^, and redefining time as t = {^ire^ / L'^)t, and D'^ = D^/l^ire^ / L'^] 
one obtains: 



dC{^,t) 



dip' sin {ip - ip') C{ip',t)}C {if, t) 



Next, a small perturbation of the homogeneous steady state is considered: 



(389) 



(390) 



Note, that e™*^ are eigenfunctions of the operators emerging from the linearization of Eq. (|389p 
near the homogeneous steady state. By substituting into Eq. p89p and keeping only terms 
linear in Co, we obtain the foUoviring eigenvalues: 



i?e(A) = -D'^n^ - 

The only mode which can become unstable is n =: 
instability of the homogeneous, disordered state is 



Po > 



2D^ 



7rC*(5„,i. (391) 
1 and the condition for the corresponding 

(392) 



with Po ~ N jl? . For a given noise amplitude D^p, there is a critical particle density above which 
the homogeneous solution is unstable. Fig. [5Wa) shows that as a result a single peak emerges 
in C((^) from numerical integration of Ea. p89[) in line with results found in simulations of the 
Vicsek model. 

An analogous procedure for LC-alignment yields: 



dr 



D'd^^C{^,t) 



(393) 



dip'2 cos {ip - if') sin {ip - ip') C{>p',t)}C [ip, t) 
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As above a small perturbation to the homogeneous distribution C{tp,t) — C* is assumed, see 
Eq. 13901 Again, e™"^ are eigenfunctions of the linearized operator. Substituting Eq. p90|) into 
Eq. p93p and keeping terms linear in Co the following expression for the eigenvalues is obtained: 

i?e(A) = -D'^n^ + 27rC*(5„,2 (394) 

As for F-alignment, there is only one mode which can become unstable, but this time it is 
n = 2. The n = 2-mode exhibits two peaks separated by tt, that correspond to two populations 
of particles moving in exactly the opposite direction. The homogeneous state is unstable for: 

Po > 1 395 

Again, this inequality defines a critical density above which the homogeneous solution is no 
longer stable. Fig. ISST c'l-fd) shows the emergence of these two peaks for LC-alignment in 
individual-based simulations. Numerical integration of Eq. p93|) above this critical density 
shows again two peaks in C((^,t), see Fig. ISgTb') For a given density, there is a critical D^^^- 
Close to D^p^c we expect to observe that only one mode dominates C{ip,t). As already men- 
tioned, ri = 1 is dominant for F-alignment and n = 2 governs LC-alignmcnt. The steady state 
distribution C'sti^) near the instability has the form: 



C,t (<p) ^ C* + Bi ^D^,c - cos(^ - ^o) (396) 
for F-alignmcnt, while for LC-alignmcnt it is: 



Cst{ip) ^C*+ B2^D^^, - cos(2(v? - m)) (397) 

where Bi , B2 are constants and Lp^ is an arbitrary phase. In both cases the maximum amplitude 
of Csti^p) close to the D^^c grows as \jD^,c — D^. Inserting Eq. p96|) into Eq. (j38ip . we obtain 
the scaling form of the order parameter S^: 



S^-Bi^lj~T^ (398) 

where Bi is a constant. To obtain the scaling of the order parameter S^^ , Eq. p97l) is inserted 
into Eq. ((5g^ : 

S''^-l + B^Vv^ (399) 

where again B2 is a constant. The above results confirm our findings for active Brownian 
particles from Sec. 16.2.21 in the limit of vanishing velocity fluctuations. 

It is instructive to compare the results of the mean-field theory qualitatively to the results of 
individual-based simulations with respect to the scaling properties of the order parameters near 
the onset of orientational order. In addition, the prediction of the mean-field theory regarding 
the different critical noise amplitudes (resp. critical densities) for F- and LC-alignment can be 
compared with simulations of the Vicsek- and Peruani-modcl. 

Fig. inni shows a comparison between the scaling predicted by the mean-field approach for 
S^^ (dashed curve) and the one obtained from individual-based simulations in the limit of very 
fast angular relaxation (symbols) . One finds good agreement between the mean- field prediction 
and the simulations for the scaling of S near r]c that suggests that individual-based simulations 
with LC-alignment at high densities exhibit a mean-field type transition. Evidence seems to 
point towards a mean-field transition if we look at the scaling of the maximum amplitude of 
the angle distribution as function of the angular noise intensity 77 (see Fig. 150)) . 

Finally, Fig. [501 shows that in individual-based simulations with the same parameters and 
different (namely LC- and F-) alignment mechanism, the limit of fast angular relaxation yields 
Vc^ < rj^ as predicted by the mean-field theory. Note, however, that the simulations yield 
2r]^^ ~ Vc , while the mean- field description predicts y/2r]^^ = rj^ . 
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Fig. 60. Comparing simulations of particles with F-alignment (crosses) and LC-alignment (circles) 
in the limiting case of very fast angular relaxation. In both cases iV = 2^^ and p = 2.0. Notice that 
the order parameter for F-alignment is while for LC- alignment is S^'^ (See text) . The dashed 
horizontal line indicates the minimum value that S^'^ could take. The dashed curves correspond to the 
best fit assuming an exponent 0.5, i.e., 77c was the fitting parameter [267| . 



In summary, we have derived a mean-field theory for self-propelled particles vifhich accounts 
for F- and LC-alignmcnt. This approach predicts a continuous phase transition with the order 
parameter scaling with an exponent one half in both cases. In addition, the critical noise 
amplitude below which orientational order emerges is smaller for LC-alignment than for F- 
alignment, i.e., 77^*^ < 77^. These findings were confirmed by individual-based simulations with 
F- and LC-alignment. 

Furthermore, we have assumed spatial homogeneous density to study the emergence of 
orientational order. Thus, the presented approach does not apply to situations where self- 
propelled particles show clustering at the onset of orientational order as will be discussed in 
the next section (Sec. [7]). A better understanding of the problem should imply the study of the 
interplay between local orientational order and density fluctuations. 



6.3 Alternative swarming mechanisms 

6.3.1 Escape and pursuit — collective motion and group propulsion 

Motivated by recent observations on cannibalistic behavior in locusts and crickets |319l24j . 
we introduced a model of individuals (active particles) responding to others with escape and 
pursuit behavior [289126] . This biologically motivated interactions cannot be expressed simply 
in terms of an interaction potential as discussed in Section 16.11 and do not include a velocity 
alignment term as discussed in Sections 16 . 1 1 fc but constitute selective, velocity dependent 
attraction and repulsion interactions. Nevertheless they may lead to the onset of large scale 
collective motion in particular at high densities of individuals. 

The behavioral response of the insects, which are particularly vulnerable to attacks from 
behind, was assumed in the following way: 

— If approached from behind by another individual j a focal individual i increases its velocity 
away from it in order to prevent being attacked from behind. We refer to this behavior as 
escape (e). 
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— If the focal individual "sees" another individual up- front moving away, it increases its ve- 
locity in the direction of the escaping individual. We refer to this behavior as pursuit (p). 

— No response in all other cases. 

The motion of individual particles in two spatial dimension obeys the following Langevin 
dynamics: 

r, =v„ V, = -7vr V, + + V2^C, . (400) 

The first term on the left hand side of the velocity equation (j400p is a friction term with 
coefficient 7 and an arbitrary power-law dependence on velocity represented by a = 1, 2, 3, ... . 
The social interaction of particles is described by Ff . The last term is a non-correlated Gaussian 
random force with intensity D. A non-interacting particle (F| — 0) explores its environment 
by a continuous random walk, where the individual velocity statistics are determined by 7, a 
and D. 

Furthermore we assume finite-size particles and introduce fully elastic hard-core collisions 
with a particle radius Rhc = {l,- - particle diameter) (see e.g. [JJ. 

The social force acting on the focal particle i is given as a sum of escape and pursuit force: 
Ff = ff + ff with 

rji)e{rj, - lr)0{~^t ■ rj,)0{~v,ei) (401a) 

r,,)0{r,, - lr)e{+^., ■ r,,)0(+w,ei) (401b) 

where Vji = {rj — ri)/\rj — r^l is the unit vector in the direction of the other individual j, and 
Vrei = ^ji 'iji = IS the relative velocity of individuals j and i. The functions K^^p > 

determine the strength of the interactions. In the following we assume the response functions 
proportional to the relative speed: K^^p = Xe.pK'rcil, where Xp,e ^ are the corresponding 
interaction strengths. This choice of the response function leads to stronger response to fast 
approaching/escaping individuals in comparison to slowly moving ones. 

The product of the 6*- functions (step functions), which define the condition for the es- 
cape/pursuit interaction to take place can assume only two values: either 1 or 0. The product 
of the first two step functions is identical for both interaction types. It is 1 only if the individual 
j is within the social interaction zone defined by the hard-core distance Ir and the sensory range 
Is'. Ir < Tji < Is- The product of the last two step functions distinguishes the escape and pursuit 
interaction. The escape interaction takes place only if individual j is behind the focal individual 
i (vi • Tji < 0) and is coming closer {v^d < 0), whereas the pursuit interaction takes place only 
if the individual j is in front of the focal individual i (v.^ • rji > 0) and is escaping it (wroi > 0). 

The most important property of this asymmetric interactions is their anti-dissipative nature 
with respect to kinetic energy. Note that Ff leads only to acceleration of individuals and is 
analogous to the auto-catalytic mechanism proposed in |24| . 

Large scale numerical simulation of a iV-particle system in a rectangular domain of size 
L X L with periodic boundary conditions show that at high density the escape and pursuit 
interaction leads to collective motion irrespective of the detailed parameter choice as long as 
the interaction is strong enough to counterbalance the individual fluctuations. Here we use for 
convenience a dimensionless density ps = Nll/L"^ scaled by the interaction range. 

At low Ps the behavior of the system depends strongly on the relative strength of escape and 
pursuit. This can be best understood if we consider the extreme cases of pure escape (xp = 0) 
and pure pursuit (xe = 0). 

In the escape only case the particles try to keep their distance with respect to individuals 
approaching from behind. To the front only interactions via the short range repulsion take 
place. At low ps an escaping particle will eventually move away from the approaching one. 
The probability of interaction within the characteristic time of velocity relaxation vanishes and 
the particles perform effectively a disordered Brownian motion. As ps increases the frequency 
of escape interactions increases and an escaping particle will trigger escape responses from 
neighboring particles. We observe velocity correlation over several interaction length scales. 
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Fig. 61. Typical spatial configurations and particle velocities (small arrows) for pure pursuit (p), 
pursuit+escape (p+e) and pure escape (e) cases at different particle densities ps = 0.30, 1.25, 2.25. 
Mean migration direction and speed U is indicated by large arrows (f/ ~ for escape only and ps <^ 1) 
[289] . 




200 



Ps 



Fig. 62. (a) Mean velocity (U) for escape-only (circles) Xe=10, Xp=Oi pursuit-only (crosses) Xe=Oi 
Xp=10 and symmetric escape-|-pursuit (squares) Xe=Xp = 10 vs. pa obtained from numerical simulations 
with periodic boundary conditions (7=1, Z)=0.05, a=3, lr=2, Zs=4; only translational solutions were 
considered; error bars represent one standard, deviation). Vortex formation for pursuit only: Initially 
a rotating cluster nucleates from collision of two translational clusters at a:: ~ 50, y ~ 180 (b), which 
then grows through absorption of other translational clusters until a single rotating structure emerges 
(c). Figure adopted from [289) . 



Finally at high ps a highly ordered state emerges where all particles are able to correlate their 
motion. At all ps the density remains almost spatially homogeneous. 

In the pursuit-only case the dynamics change dramatically: At low ps we observe a highly 
inhomogeneous state initiated by formation of small particle clusters performing coherent col- 
lective motion. Without escape interaction the density of the clusters is only limited by the 
hard-core radius. At moderate noise intensities the clusters are sufficiently stable and a pro- 
cess of cluster fusion can be observed where larger clusters absorb smaller clusters and soli- 
tary particles. The typical stationary configuration in a finite system with periodic boundary 
condition, and moderate noise, is a single cluster performing translational motion (Fig. I5T|) . 
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The migration speed ([/) in Fig. I62r a) is given by the mean speed of a single cluster (u) = 
I Sisciustcr'^il/^ciustcr- For large clusters (u) becomes independent of the cluster size and 
therefore independent of ps- It should be emphasized that this holds only for finite systems 
with sufficiently strong pursuit interactions. In general there is a finite probability of a large 
pursuit-only clusters to break up into smaller clusters which increases with cluster size and 
noise strength. The resulting different clusters will in general move in different direction which 
results in ([/) — )■ for L, — cx) and constant overall density ps = const. <^ 1. 

An intriguing feature of the pursuit-only interaction is the possibility of the formation of 
large scale vortices out of random initial conditions (Fig. IS^.c). for example via a collision 
of clusters moving in opposite direction. The vortices may decay either via a collision with a 
translational cluster or through random fluctuations. For certain parameters the vortices are 
very stable and may dominate the stationary configurations for the pursuit-only case. The 
emergence of vortex-structures is in particular remarkable because so far they have only been 
reported for systems of self-propelled particles with confinement, or attracting potential, re- 
spectively |72I84I35S] . Here, the pursuit behavior has two functions: a propulsion mechanism 
and an asymmetric attraction. 

Both interactions — escape and pursuit — lead to collective motion of groups but have 
an opposite impact on the density distribution. Whereas the escape interaction leads to a 
homogenization of density within the system, the pursuit interaction facilitates the formation 
of density inhomogeneities. Thus the combined escape-|- pursuit case with XpiXe > 0, is a 
competition of this two opposite effects. The stability of clusters is determined by the relative 
ratio of the interaction strengths. In general for the escape-|-pursuit case at low ps we observe 
fast formation of actively moving particle clusters with complex behavior: fusion and break up 
of clusters due to collisions as well as spontaneous break up of clusters due to fluctuations |289j . 

The anti-dissipative nature of the escape and pursuit interactions leads to persistent trans- 
lational motion of interacting Brownian particles. Individual clusters may be considered as 
self-propelled structures where the propulsion is purely due to social interactions, and consti- 
tutes an example of group-propulsion. 

The scaling of the speed of individual clusters can be derived by considering the smallest 
possible cluster: a particle pair. We assume particle 1 is in front of particle 2 and |ri2| < Is at 
all times. The transformation of Eq. 14001 into polar coordinates with = {vi cos Sipi , Vi sin S(pi ) , 
where Sipi is defined as the angle between v,; and ri2, yields: 



Here vi2 = I'l — V2 is the relative velocity of the two particles and ^^_i,(,v.i represents the 
transformed noise variables. For —tt/2 < ipi,ip2 < 7r/2 the escape and pursuit interaction leads 
to an increase of either vi or V2 in order to harmonize the speed of the slower particle with 
the faster one. In addition the interaction stabilizes the translational motion along fi2, i.e. 
{5(fi) — >■ (Eqs. I402b .d). After the system relaxes to a stationary state (f 12 varies slowly in 
time) we end up with quasi one-dimensional translational motion of the particle pair with slowly 
diffusing direction of motion defined by fi2. Please note that for elastic hard-core interaction 
the total energy and momentum of the particle pair does not change during collisions. 

In order to obtain equations of motion for the particle pair in the stationary translational 
state, we assume that the particle velocities are given by the time averaged mean velocity u of 
the particle pair plus a small deviation: Vi — u + Svi. Furthermore the particles are assumed 
to have approximately the same heading so that 5(pi <C 1. Assuming vanishing mean of speed 




(402d) 



(402b) 



(402a) 



(402c) 
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deviations (Svi) = 0, wc obtain for the time evolution of the mean pair velocity: 

= - 7"" + Y(l^'i2|e(-«i2)) + |^(|^'i2|e(+^'i2)) (403) 

In the symmetric case where Xe ^ Xp ~ X the social force terms on the right hand side can be 
summed up and we obtain: 

lu = -^u^ + ^M (404) 

There is permanently a social force acting on one of the particles. In order to evaluate the 
expectation value of the social force we assume that at all times one of the particles moves 
with the mean velocity u ((5wi,2 = 0) whereas the velocity of the second particle deviates by 
Sv as a result of the stochastic force. We approximate the expectation value {\Sv\) = (|i'i2|), 
by considering the speed deviations as discrete increments taken from a Gaussian distribution 
with zero mean and variance = 2Dt (Wiener process) with r = x~^ being the relaxation 

time of the escape+pursuit interaction: (|ui2|)id = 2w ^ 



D_ 

In the limit of quasi one-dimensional motion we obtain 



— M = -7u° + ^/^, (405) 



which results in a stationary pair velocity u 



ep 




(406) 

For symmetric escape and pursuit the particle distance increases slowly due to fluctuations 
which are not fully compensated by the social force, and the pairs break-up at finite times. 
Stable pairs, with stable particle distance are only possible for pursuit dominated dynamics 
and in particular for the pursuit only case Xe = 0. 

In contrast to the escape and pursuit interaction for pursuit only the social force act not 
all the time but only if the leading (first) particle is faster then the pursuer. Thus individual 
velocity deviation from the mean, as well as are larger for pursuit only, in comparison 

to the escape-|-pursuit case. We consider now both velocity deviations Svi and Sv2 as stochastic 
variables. In analogy to symmetric escape and pursuit we approximate (|wi2|) by considering 
discrete Gaussian increments with zero mean and variance (t| = 2(t^ = ADt (difference of two 
independent stochastic processes variance af). The resulting evolution equation for the velocity 
in the pursuit only case reads: 



with the stationary speed 



l" = --" + Vl5?> (407) 



(408) 




The obtained analytical expressions for the averaged pair velocity (u) are confirmed by nu- 
merical simulations for a wide parameter ranges as shown in Fig. [63] (see also [289]). Deviations 
become apparent where the pair dynamics deviate strongly from the effective one-dimensional 
situation as for example for weak coupling strengths x- 

Thus we have shown that although isolated particles perform (nonlinear) Brownian motion, 
the escape and pursuit interactions leads to rectifications of individual fluctuations of interacting 
particles leading to a collective propulsion with a non-vanishing stationary velocity. Based on 
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Fig. 63. (a) Mean pair velocity (u) for symmetric escape and pursuit (a,b) and pursuit only (c,d) versus 
interaction strength (a,c) and friction coefficient (b,d). The symbols represent the results obtained from 
numerical simulations of interacting particle pairs for linear friction a = 1 (circles) and nonlinear friction 
a = 3 (squares). The solid lines represent the corresponding analytical result Eq. (|406|) (a,b) and Eq. 
(|408)> (b,d). 



Eqs. (j406p and (j408p we can consider a pair (or even a cluster) as a single active Brownian 
particle with a velocity-dependent friction function of the form: 

— 7(ii)ii = a - 7ii° (409) 

with a constant pumping term a accelerating the pair and a friction term —77/". For a ~ 1 this 
corresponds directly to the Schienbein-Gruler friction introduced in Section [XT] 



6.3.2 Chemotactic coupling 

Another kind of coupling leading to collective dynamics is known from microbiology. Many mi- 
croorganisms, as for example different bacteria strains, are able to sense various chemical agents 
in their environment and bias their motion along their concentration gradients. This ability is 
referred to as chemotaxis (see |105j for a review). Our modern understanding of bacterial chemo- 
taxis was strongly influenced by the systematic investigations performed by J. Adler, H.C. Berg 
and their collaborators in the 60's and 70's of the past century |3I4I5I33I30I34I46] . Since then a 
large number of publications has appeared on various experimental and theoretical aspects of 
chemotaxis (see e.g. 1151281431741358] ). 

Chemotaxis plays an important role for the survival of microorganisms in general, as it en- 
ables them to move towards beneficial environments and away from hostile environments. In the 
case, where individual cells bias their movement towards higher (lower) concentration of poten- 
tially beneficial (dangerous) chemical substances, the corresponding chemical agent is referred 
to as chemoattractant (chemorepellent). Effective coupling of individual cells comes from the 
ability of different microorganisms to produce the respective chemoattractant (chemorepellent) 
by themselves. By these means bacteria are able to exchange information about favorable or 
disadvantageous environmental conditions. 

The auto-chemotactic interaction was identified as the mechanism responsible for complex 
spatio-temporal patterns of cell clusters that were observed in colonics of chemotactic bacteria 
such as Escherichia coli or Salmonella typhimurium |48I49I36T] . 

Most models employed for the description of bacterial colonics with chemical cell-to-cell 
signaling (chemotaxis) are based on the classical Keller-Segel model (KSM) |187ll88j . It is 
a continuous model of partial differential equations (PDEs) for the dynamics of the bacte- 
rial density p{r,t) and the concentration(s) of the involved chemical agent(s) c{r,t) (see e.g. 
|346l226l240ll5I] ). 

Here we discuss briefly models of (active) Brownian particles interacting via a self-generated 
chemoattractant, as an alternative to a pure PDEs approach |310I72I292] . 

We consider an ensemble of N (active) Brownian particles in two spatial dimensions, each 
described by individual equations of motion coupled to a self-generated chemoattractant con- 
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centration field c(x,t): 

r, = V, (410a) 
v.. = -7(v,)v, + k(c)V, c(r,) + V2Dt^ . (410b) 

The chemotactic force (second term in velocity equation) consists of a chemotactic sensitivity 
function k(c) which may depend on the concentration c and the gradient Vc at the position of 
the individual particle (cell). Thus depending on the sign of k(c) the force acts either in the 
direction of the gradient (chemoattractant, k(c) > 0) or in the opposite direction (chemorepel- 
lent, k(c) < 0). Here we will restrict for simplicity to the discussion of chemotactic coupling via 
a single chemoattractant. 

The dynamics of the chemoattractant concentration c are assumed to obey a diffusion equa- 
tion: 

N 

c(r, t)^qoJ2 -^(i" - -dc + DcAc. (411) 

1=1 

The first term describes the production of the chemoattractant by the individual particles with 
rate qo at their respective positions r^. Furthermore the chemical agent c is assumed to decay 
with the rate dc and to diffuse with the diffusion coefficient Dc- 

A simple model of chemotactically interacting Brownian particles with constant friction 
coefficient j{v) = 70 = const. (Stokes friction) and constant chemotactic response k(c) = kq, 
was studied by Schweitzer and Schimansky-Geier |310| (SSG-Model). 

Depending on the model parameters they observed formation of spike patterns of the 
chemoattractant field c. The spikes correspond to particle clusters aggregating at high concen- 
tration of c. The positive feedback between the spike "height" and attraction on other particles 
leads to a competition between spikes following an Eigen-Fisher like dynamics. After a certain 
relaxation time only few spikes "survive" , but even if the dynamics of the system slows down, 
in the limiting case of t — c» the only stationary solution is a single spike of the chemical field 
or cluster of particles, respectively. This process can be seen as an Ostwald-ripening process 
known from chemical reactions |311l369j . 

In the case of Stokes friction the particles within a stationary chemotactic cluster perform 
purely diffusive motion in an effective confining potential caused by the concentration profile of 
c. The introduction of active (self-propelled) motion via a velocity dependent friction function 
leads in general to complex rotational motion of individual particles within the cluster. In the 
absence of any additional symmetry breaking interaction no collective rotational modes are 
possible and the total angular momentum averages to zero. 

Although bacteria are able to sense chemoattractant concentrations over several orders of 
magnitude via membrane receptors, it is known that at high c they lose the ability to follow 
the gradient. This can be taken into account in simple form by the so-called "receptor law" 
[28|240| . The resulting chemotactic force may be written as: 

- (TTW ^'''^ 

with Kq being the sensitivity coefficient and S being the saturation coefficient which takes into 
account the saturation of chemotactic receptors at high c leading to a decreasing sensitivity 
with increasing c. 

The macroscopic behavior of the model for low S is similar to that observed in the SSG- 
model but with increasing S (or increasing concentrations c) the observed macroscopic patterns 
and microscopic dynamics within the cluster change. 

The decrease of the chemotactic force at high concentrations c for S > 0, makes particles 
insensitive towards the gradient of c — the particles are able to leave the maxima of the field 
distribution. This behavior has significant impact on the macroscopic pattern formation. At 
large S any formation of clusters may be inhibited and at moderate values of S' a "smoothing" 
of spikes in the concentration profile towards flat spots can be observed [292) . 
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For the study of pattern formation we neglect the microseopie feature of active motion 
and consider the particles to behave as normal Brownian particles with a constant friction 
7(vi) = 7o = const.. This approach can be justified by the small stationary velocity of bacteria. 
With this assumption and in the overdamped limit (Smoluchowski limit) we can derive a simple 
PDE for the evolution of the particle density p. The two PDEs for p and c give us a reactions- 
diffusion system with chemotaxis which represent a variant of the Keller-Segel model. A similar 
system has been studied by Tyson et al. [346l347j : 

p(M) = v(-:^^^^Vc + 7.Vp), (413a) 

c = go/O - 4c + DcAc. (413b) 

Here, D — D/^^ is the spatial diffusion coefficient of the overdamped particles. 

The simplest stationary solution of (j413p is the homogeneous solution, given by the averaged 
particle and chemoattractant concentrations: p = N / L"^ and c = qop/dc. Analyzing the linear 
stability of the homogenous solution with respect long wave spatial perturbations we arrive at 
the condition which has to be fulfilled for stable spatially homogenous solution: 

Djpdc ( qo _Y , , 

Ka<— 1 + -5^3-/0 = Kc- (414) 

pqo V "c / 

For dc > and kq smaller than the critical sensitivity Kc all fluctuations around the homoge- 
neous state decay exponentially. Only if kq > Kc pattern formation on the macroscopic scale 
can be observed. 

Although this result was derived for overdamped dynamics it can be also applied for actively 
moving particles with a Rayleigh-Helmholtz friction function, by taking the friction coefficient 
from the Stokes friction as a single fit parameter j292] . 

Not only the macroscopic dynamics but also the microscopic behavior of actively moving 
particles within a cluster depend strongly on the involved chemoattractant and chemotactic 
parameters. In the case of strong confinement (e.g. low S"), the particles perform complex rota- 
tional motion, as discussed in Section[5] But for large S and low diffusion of the chemoattractant 
we observe extended clusters where the chemoattractant concentration within a cluster is rather 
high but approximately constant but drops sharply at the cluster boundary leading to a steep 
gradient. Inside such clusters the particles perform effectively free motion and are able to sense 
chemoattractant gradient only at the cluster boundaries which prevents them from leaving the 
cluster gnS- 

If the coupling via the self-generated chemoattractant is the only interaction between par- 
ticles, no collective dynamics within a cluster take place and the center of mass of a stationary 
cluster performs at most slow diffusive motion. This changes dramatically if in addition to the 
chemotactic coupling we include the velocity alignment as introduced in Sec. 16.2.21 Increasing 
the alignment strengths leads first to a transition from disordered motion within a cluster to 
collective rotation within a stationary cluster. This situation corresponds to the dynamics in 
an external central field 16.2.21 A further increase in alignment strength enables the particles to 
escape collectively out of the stationary maximum of c. As the particles keep on producing the 
chemoattractant, they drag a cloud of chemoattractant around them and we observe a compact 
chemically bounded moving cluster of particles (see Fig. [M)) . 
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Fig. 64. Active particles with chemotactic coupling and velocity alignment. The chemoattractant 
concentration c is indicated by the background color with dark (bright) regions indicating low (high) 
c. Left: Collective rotation at intermediate velocity alignment strengths. Each particle is shown by its 
velocity vector. Right: A moving cluster for strong velocity alignment. Only the position (symbols) and 
the mean velocity is shown (vector). 
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Fig. 65. The rotational motion (L) and parallel motion (Cw) order parameters for an individual 
cluster of particles over the velocity-alignment strength x- Depending on x three different states can 
be identified: (A) no collective mode of motion; (B) collective rotation; (C) collective translation, 
(simulation parameters: kq = 1 x 10~^ mm*s~^ , 5 = 6 x 10~^ mm^, dc = 0.1 s~^,D = 1 x 10~''mm^s, 
iV = 3000 and Z„a = 2 x 10"^ mm 
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7 Pattern formation of active particles 

In this section, various aspects of pattern formation in active matter systems arc considered. 
Often pattern formation in active systems like self-propelled or driven particles refers to the 
formation of substantial spatial inhomogeneities in the density of the particles. Phenomena like 
giant number fluctuations, phase separation and clustering phenomena fall into this class and 
have all been observed in experiments [24412701298] , predicted or reproduced by theoretical anal- 
ysis and numerical simulations of appropriate models |235l266.278.269i343j . Another frequent 
phenomenon in the collective dynamics of active particles is the formation of high-density bands 
in a low-density environment (segregation bands), that may travel at a constant speed (as for 
the classical Vicsek model) or can be stationary (as for self-propelled rods) [60 59 136 2421 . The 
high density inside such segregation bands often is associated with polar or nematic alignment 
order, while the low density environment typically is disordered. The precise nature of these 
bands (stationary or moving, polar or nematic order) is often determined by symmetries of the 
system, like the nature of the active particles (polar or apolar) and the specific of their inter- 
actions (ferromagnetic or nematic) |59ll36j . Finally, active particles may also exhibit classical 
pattern formation phenomena such as Turing-type patterns or periodic standing and traveling 
waves of the density, compare e. g. [42] . In comparison to standard pattern formation systems 
like Benard convection or chemical reaction-diffusion systems where molecular and pattern scale 
differ by many orders of magnitude, typically the length scales of pattern formation and the 
particle size in active matter are comparable [H]. This allows for agent-based approaches as 
introduced in Section |6l where the motion and dynamics of each particle is simulated. This 
section is structured as follows: First, we will briefly describe the results of continuum theories 
and their relation to findings in agent-based models. Then, work on clustering of self-propelled 
particles is reviewed. As an example, a simple physical model of self-propelled hard rods and 
simulation results therein are described. A theoretical analysis of clustering via a Smoluchowski- 
type kinetic approach is introduced and applied to simulations with hard rods and experiments 
with myxobacteria. Related phenomena in Vicsek-type models, models of colloids and granular 
experiments are also surveyed. Second, we describe formation of large-scale coherent structures 
like traveling and stationary high-density bands in simple models for self-propelled particles, 
namely the Vicsek model and a variation describing polar particles with apolar alignment inter- 
actions and their instabilities. Due to the rapid development of the studies in collective motion 
of active (Brownian) particles, we concentrate on detailed descriptions of recent developments. 
The review in this section is by no means exhaustive and relevant original and review papers 
will be cited and may be consulted. Nevertheless, the examples selected and the discussion will 
address the most important issues. The main message of this section is that different forms 
of spatial organisation like clusters and large-scale patterns, are crucial for a complete under- 
standing of the collective dynamics of active particles. Hence, the approaches introduces in this 
section are necessary to complement the picture sketched in the previous section on swarming. 

7.1 Continuum theories versus agent-based models 

In agent-based models, one encounters often strong finite size effects. The same model may 
yield clustering and giant fluctuations for small and intermediate particle numbers as well as 
coherent structures and large-scale patterns for big particle numbers. In addition, bands and 
other large-scale patterns can have instabilities against modes of a definite wavelength, that 
may be absent in smaller system, but highly relevant in sufficiently large systems. Such stability 
properties of patterns are also quite relevant for the presence of long-range order or non-zero 
global order parameters. 

Alternatively, coarse-grained, hydrodynamic continuum models have been frequently em- 
ployed to advance the understanding of collective dynamics in active matter. It would be highly 
desirable to establish links between the two levels of descriptions. Such efforts are, however, 
limited by the fact that continuum models address typically length scales that involve very 
large number of particles. As a result, the study of the corresponding agent-based models is 
often computationally extremely expensive or even prohibitive. Simulations of "microcospic" 
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agent-based model are nevertheless very important, since they are necessary to understand the 
role of the noise and the fluctuations as well as the limitations of the validity of hydrodynamic 
descriptions. Agent-based models also allow for a simultaneous computation of coarse-grained 
properties like densities or alignment and of characteristic of individual particle motion. In 
other words, they can be used to establish a link between an Eulerian and Lagrange view 
of active matter systems |255] . Often, both Eulerian and Lagrangian properties of active sys- 
tems are accessible to experiments. For example, fluorescence labeling allows for tracking of 
individual cell motion in bacterial films, while density patterns are conveniently determined 
by microscopy |361ll70j . This enlarges the amount of information necessary for quantitative 
validation of models substantially. 

In contrast, continuum theories are useful to describe the large-scale behavior of active 
Brownian particles. Shortly after the first publication on the Vicsek model, Toner and Tu 
carried out pioneering work deriving a continuum theory for active systems like the Vicsek 
model. Their work analyzes a coarse-grained hydrodynamic description based on the velocity 
field V and the particle density p. These equations are of the general form: 

(a - /3v • v)v -I- rVVv - VP(/9) + ^ (415) 

^ + V • pv = 0. (416) 

Eqs. 14151 - 14161 capture the phase transition from the disordered state v = to the ordered 
state V — \J a/ p. The analysis of Toner and Tu gave an explanation of the long-range order 
in two-dimensional systems, that is absent in equilibrium systems and had been previously 
observed in the simulations by Vicsek and colleagues. Moreover, it allowed the derivation of 
sound modes and lead to the prediction of giant number fluctuations, that shall be discussed 
below. A detailed discussion of the Toner- Tu field theory can be found in |343I277) . The number 
fiuctuations in the collective dynamics of a many particle system are often expressed as 

AN oc TV"^, (417) 

where AN is the standard deviation of the particle number in a given finite volume. The 
quantity N gives the mean number of particles in this volume. Equilibrium systems exhibit 
normal fiuctuations with = 1/2, whereas active systems often show (j) > 1/2. Such behavior 
out of equilibrium is consequently referred to as giant number fluctuations. The Toner- Tu field 
theory predicts </> = 7/10 -I- l/5d for d < 4, where d is the spatial dimension of the system. The 
predicted value (j) = 0.8 in two dimensions has been recently confirmed in extensive numerical 
studies of two agent-based models, namely the original Vicsek model [SI] and the Peruani model 
|136j . in the ordered state without segregation bands. Giant number fluctuations have also been 
studied for active nematics (=driven apolar particles), where an exponent (j) = 1/2 + 1/d was 
derived from field theory, see (2781277] . where d again refers to the spatial dimension of the 
system. In two dimensions, the predicted value of (/> = 1 was recovered from extensive numerical 
simulations of a Vicsek- type simple agent-based model [60] . Coincidently, researchers have found 
in recent experiments with bacteria [3741270] similar exponents {(j) ~ 0.8) in two dimensions. 
In the latter case, the interpretation of the giant number fluctuations remains controversial 
because of the simultaneous observation of large coherent clusters of the investigated bacteria. 
Such clustering provides an alternative reason for giant number fluctuations and violates the 
assumptions of the Toner- Tu field theory. A similar controversy appeared in connection with 
experiments of shaken elongated rice corns that were devised as a realization of an active nematic 
and show giant number fiuctuations |244] . The initial interpretation of these measurements as 
confirmation of the predictions of continuum theory were later contested |11] by pointing out 
the strong tendency of this system to form clusters. In general, the formation of clusters or 
large-scale patterns like segregation bands is expected to have a strong infiuence on the number 
fiuctuations and goes beyond the range of validity of continuum theories. 

Alternative continuum theories have been recently also been investigated by Marchetti and 
coworkers based on symmetry consideration and expansions [231234] as well as for a specific 
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approach describing self-propelled hard rods |22l21j . Bertin and coworkers have pursued a con- 
tinuum theory based on a kinetic approach |36| and have been able to recover qualitatively the 
traveling segregation bands seen in simulations of the Vicsek model |37j . 

Altogether, continuum theories have contributed a lot to the understanding of the collective 
dynamics of active Brownian particles. In recent years, large-scale agent based simulations 
and experiments with, e. g., driven granular particles or moving bacteria, have revealed many 
interesting phenomena that pose new challenges to continuum theorist. Many open questions 
revolve around the issue of prediction of spatial inhomogeneities, large-scale patterns and cluster 
formation which all have been found to play a dominant role in agent-based simulations and 
experiments. In the following subsections we will discuss recent developments in agent-based 
models and related experiments. 

7.2 Clustering, segregation and band patterns - phenomena and experiments 

Examples of large-scale self-organized patterns in systems of self-propelled particles with short- 
range interactions are found at all scales, from groups of animals j256l54l35] and human 
crowds |155| down to insects |50l289j . bacteria j374j . or actin filaments f51'298J. Such pat- 
terns are also found in non-living system like in driven granular media [544 202 2 01I80| . Despite 
the fact that the interaction mechanisms between individual elements are of a different na- 
ture, it is possible to determine some common requirement to achieve large-scale (spatial) 
self-organization. Particularly important for the emerging macroscopic patterns are the self- 
propulsion of the agents, and their velocity alignment mechanism. As described above, simple 
individual-based models like the Vicsek model |354| have helped to reveal the relevance of these 
two elements by reducing the problem to the competition between a local aligning interaction 
and noise |58j . Recall, that in two dimensions, self-propelled particles moving at constant speed 
with a ferromagnetic-like velocity alignment exhibit at low noise a phase characterized by true 
long-range polar order which translates into a net flux of particles |354l59j . In the previous 
section, we have assumed that the ordered states are spatially homogeneous. Systematic sim- 
ulations and theoretical analysis based on coarse-grained continuum models show that these 
ordered phases often exhibit several remarkable features of spatial organisation. For ferromag- 
netic alignment mechanisms, the spontaneous formation of elongated high density bands that 
move at roughly constant speed in the direction perpendicular to the long axis of the band, 
and anomalous density fluctuations for low noise levels were reported |59I234| . When the 
alignment is replaced by a nematic velocity alignment, self-propelled particles again display a 
phase characterized by true long-range nematic order at low noise intensity |136j . Interestingly, 
spontaneous density segregation processes into bands are observed for these particles as well as 
anomalous density fluctuations |136j . It is noteworthy, that self-propelled particles with display 
large-scale high-density patterns and segregation in absence of any attracting force }59ll36j . 

At moderate system sizes or particle numbers, self-propelled particles with ferromagnetic or 
nematic alignment mechanisms often do not show large-scale patterns like segregation bands. 
Nevertheless, collective motion in this regime is still characterized by strong density fluctuations. 
A phenomenon that has attracted a lot of interest recently is the formation of large polar 
clusters in many experiments and models, that again do not require attractive forces between 
the particles. It seems that the common presence of active motion and effective alignment 
forces of either ferromagnetic or nematic symmetry are sufRcient to facilitate "condensation" 
of self-propelled particles into clusters. This effect has been studied extensively for alignment 
that results from volume exclusion interactions among self-propelled rods |266: 265 368 . Related 
findings appeared in models for colloidal rods j362j , experiments and models of driven granular 
particles |202] and models describing collective motion of sperms [3671368] . In many instances 
the appearance of polar clusters was linked to a power-law cluster size distribution j266l367l368j . 
Clustering effects and the emergence of steady state cluster size distributions in self-propelled 
particle systems were also observed in the Vicsek model [1651166] and the Peruani model [269j . 

In the following subsections, we will first discuss first the formation of polar clusters in a 
model of self-propelled rods and describe a simple kinetic theory from which the steady state 
cluster size distribution of self-propelled particles is obtained. This approach is a modification of 



130 



Will be inserted by the editor 



the Smoluchowki kinetic equations that were developed to describe the aggregation of colloids 
[320l57j . Then, we will show that similar phenomena appear and a related kinetic description 
for the cluster size distribution applies also to models of self-propelled particles with velocity 
alignment as outlined before in j265l269j . In the second part of the second of the section, we 
review results on the formation of large-scale structures in models with velocity alignment. 
Finally, we give an account of results obtained in coarse-grained continuum descriptions of 
collective motion in active matter specifically designed to account for the phenomena observed 
in the simulation studies discussed before. 



7.3 Clustering, phase separation and giant number fluctuations 

7.3.1 Clustering of self-propelled hard rods 

Emergent large-scale patterns of interacting self-driven motile elements are observed in a wide 
range of biological systems of different complexity: from human crowds, herds, bird flocks, 
and fish schools 115413061343] to multicellular aggregates, e.g. of bacteria and amoebae [55] 
as well as sperms |285j . A recurrent question is how these entities coordinate their behavior 
to form groups which move collectively. Specific models for bacteria like E. coli as well as for 
amoebae like D. discoideum j28j . have been based on chemotaxis, a long-range cell interaction 
mechanism according to which individual cells move in response to chemical signals produced 
by all other cells. However, in some bacteria there is no evidence for chemotactic cues and 
cells coordinate their movement by cell-to-cell signalling mechanisms in which physical contact 
between bacteria is needed [9111811174] . Consequently, one may ask how such bacteria aggregate 
in order to communicate. Another relevant aspect is the influence of the shape of the bacteria. 
The shape has been shown to be essential for individual motion of swimming bacteria [90j . In 
contrast, the role of the cell shape for collective motion has remained mostly unexplored. It 
has been demonstrated experimentally [189] that migrating elongated amoeboid cells exhibit 
alignment effects similar to those reported in liquid crystals |248j . A prominent example for 
collective behavior with no apparent long range interactions are the striking patterns observed 
during the life-cycle of gliding myxobacteria, see e.g. [91I181I174I241| . Earlier modeling work has 
reproduced many of these patterns in three dimensions assuming either perfect alignment [42] or 
a phcnomenological alignment force [61170] . These models have all considered patterns resulting 
from exchange of chemical signals, that are absent in an early stage of the myxobactcrial life 
cycle. Nevertheless, a trend from initial independent motion towards formation of larger clusters 
of aligned bacteria is often observed. 

Here, a model of self-propelled rods that have only repulsive excluded volume interactions 
in two dimensions is considered It was found that the interplay of rod geometry, self-propulsion 
and repulsive short-range interaction is sufficient to facilitate aggregation into clusters [266] . 

Consider N rod- like particles moving on a plane, for a more detailed description see [2661265] . 
Each particle is equipped with a self-propelling force acting along the long axis of the particle. 
Velocity and angular velocity are proportional to the force and torque, correspondingly. The 
rod-shape of the particles requires three different friction coefficients which correspond to the 
resistance exerted by the medium when particles either rotate or move along their long and 
short axes. Inertial terms are neglected, i.e. the case of overdamped motion is considered. As a 
result the movement of the i-th rod is governed by the following equations for the velocity of 
its center of mass and angular velocity: 



where «,[ , refer to the velocities along the long and short axis of the rods, respectively, Ci 





1 

Cv> dip 



(418) 



indicates the corresponding friction coefficients (Ci^ is related to the friction torque), J/*-'^ refers 
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Fig. 66. Simulation snapshots of the steady states for different particle anisotropy k and the same 
packing fraction rj (a-c), and the same re and different rj (d-f). Fixing -q — 0.24: (a) before the transition, 
re = 1; (b) almost at the transition, re = 5; (c) after the transition, re = 8. Fixing re = 6: (d) before the 
transition, r] — 0.18; (e) just crossing the transition, rj = 0.24; (f) after the transition, 77 = 0.34. In all 
cases, particles = 100 and particle area a = 0.2. The arrows indicate the direction of motion of some 
of the clusters. 



to the energy of the interaction of the i-th rod with all other rods, and F is the magnitude of 
the self-p 
given by 



the self-propelling force. The motion of the center of mass r*^*-* = (vx^Vy^^) of the i-th rod is 



.,(■0 



cos (p'--^^ 



v]_ sm (p 



vl'> sin 



,(0 



cos ip 



(419) 



Particles interact by "soft" volume exclusion, i. e. 
in the following way: 



by a potential that penalizes particle overlaps 



N 

E 



(7 



(420) 



where Oo''-' = ao(r'^*\ (/^'^'^ r'^^\ (^(■')) is the area overlap of the rod i with rod j and /.i is the 
interaction strength. The simulations were performed placing N identical particles initially at 
random inside a box of area A with periodic boundary conditions. 

There are two key parameters which control the dynamics of the self-propelled rods: i) the 
packing fraction 77, i.e., the area occupied by rods divided by the total area (7/ = Na/A, where 

is the number of particles in the system, a is the area of a single particle, and A is the 
total area of the box), and ii) the length-to-width aspect ratio k (re = L/W, where L is the 
length and W is the width of the rods). Simulations yield an increase of cluster formation 
with increasing k or 77, sec Fig. 1661 Clusters arc defined by connected particles that have non- 
zero overlap area. Simulations can be characterized by the weighted cluster size distribution, 
p{m), which indicates the probability of finding a given particle inside a cluster of mass m. 
Fig. [ST] shows that for a given ?/, a critical Kc can be defined as the value of k for which the 
shape of p(m) changes from unimodal to bimodal. The figure shows also typical shape of p{m) 
before clustering, corresponding to low values of k, and after clustering, corresponding to large 
values of k. The onset of clustering is defined by the emergence of a second peak in p{m). The 
robustness of the model against fluctuations was tested by inserting additive noise terms Ri / d 
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Fig. 67. p{m) as function of the cluster size m for rj = 0.34. Symbols show the average over eight 
IBM simulations for active particles with A*' = 50 and k = 1 (circles) and k = 8 (crosses) . The lines 
correspond to the mean field theory for k = 1 (solid) and k — 8 (dashed). 



in Eqs. (|418p . which correspond to a switch from purely active to active Brownian particles 
|116I114] . Clustering is still present in active Brownian rods, albeit the transition is moved to 
larger values of k and rj. Clustering was absent in all simulations with purely Brownian rods 
(F = 0). 



Smoluchowski-type mean field approximation (MFA) 



The clustering effects in simulations described so far can be analyzed by deriving kinetic equa- 
tions for the number rij of clusters of a given size j. The equations for nj contain terms for 
cluster fusion and fission. For the fusion terms adopted kinetic equations originally derived by 
Smoluchowski for the case of coagulation of colloids |320l57j were employed, while the fission 
terms are empirically defined from the typical behavior seen in related simulations [266] . The 
numbers nj change in time according to {uj where Uj (t) is the number of clusters of 

mass j at time t. 

This description allows to consider a single rate constant for all possible collision processes 
between clusters of mass i and j, as well as a unique disintegration constant for any cluster of 
mass i. Four additional crucial assumptions are now made: i) The total number of particles in 
the system, TV = J"-i (t), is conserved, ii) Only binary cluster collisions are considered. 

Collisions between any two clusters are allowed whenever the sum of the cluster masses is less 
or equal to N. iii) Clusters suffer spontaneous fission only by losing individual particles at the 
boundary one by one, i. e. a cluster can only decay by a process by which a j-cluster split 
into a single particle plus a (j — l)-cluster. This is motivated by observations in the above 
simulations, iv) All clusters move at constant speed, v « P/C\\ ; implying that rods in a cluster 
have high orientational order and interact only very weakly with their neighbors. Under all 
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these assumptions the evolution of the rij's is given by the following N equations: 

N N-1 

fii = 2B2n2 + ^ BkUk - ^ Ak,inkni 

k=3 k=l 
N-j 

fe=i 

1 

^ Akj-knkrij-k for j = 2, , N -1 



2 

k=l 



UN = 



1 JV-1 

Bnun + 2 X! ^fc,Ar_fenfenAr_fc (421) 



k=l 



where the dot denotes time derivative, Bj represents the fission rate of a cluster of mass j, 
defined by Bj — {v/R)y/j, and Aj^k is the collision rate between clusters of mass j and k, 

defined by Aj^k = (va-o/A) (^^/j + \/ltj. ctq is the scattering cross section of a single rod. R is 

the only free parameter and is defined the characteristic length a rod at the boundary moves 
with the cluster before leaving it in a typical fission event. One sets R = aL taken into account 
that longer rods will stay attached to cluster for a longer time. 

Since co can be approximated hy L + W = ^/a + "^^j the MFA depends only 

on the parameters k, a, A, v and a. If one integrates Eqs. (|42ip with parameters used in IBM 
simulations and an initial condition Uj (t = 0) = N6ij, their solution yields steady state values 
n° for t oo. From these values, we obtain a MFA for the weighted cluster size distribution 
p(rn) = n^m/N for given values of the free parameters R resp. a. The best agreement between 
the MFA and the IBM simulations is found for a choice of a = 1.0 ± 0.05 (see Fig. [671). To 
understand the relation between the parameters of the model and clustering effects better, one 
can rescale Eqs. (|42ip by introducing a new time variable: r = tv/^/oK. The resulting equations 
depend only on a dimensionless parameter P = (k + l)a/A. Note that v ^ is scaled and does 
not affect the qualitative dynamics of the system. In the dimensionless model the parameter P 
stands for ratio between fusion and fission processes and therefore triggers the transition from 
a unimodal to a bimodal cluster size distribution. By numerical solving for the steady state 
solution of the kinetic equations, one can accurately determine a critical transition parameter 
Pc- Given the system area A, the rod area a and the number of rods this method provides 
a straightforward way to calculate Kc'. 

Ka = Pc{N)-~l (422) 

a 

It was found that in the MFA the critical parameter value Kc for the clustering transition does 
practically not depend on the number of particles as soon as iV > 50 [266J. One proceeds by 
assuming that Pc is inversely proportional with N and expresses Kc as a function of the packing 
fraction: 

Kc = C/?/ - 1 (423) 



where the constant was found to be C ~ 1.46 by comparison with simulation results [266]. 
So, for the range of parameters used in the IBM, the unimodal shape of the weighted cluster 
size distribution for small values of k and 77, and the bimodal shape for large values of the two 
parameters seen in the IBM was qualitatively reproduced in the MFA, see Fig. [67] A second 
interesting feature obtained both in the IBM and MFA is that the cluster-size distribution 
changes notably in shape from an function exponentially decaying with size to a function with 
a power-law behaviour p{m) oc m""^ at small cluster size and a second peak confined by a 
cutoff at large cluster sizes. The exponent of the power law is, however, substantially larger for 
the MFA (c « 1.35) than for the simulation of self-propelled rods (c ~ 0.95). The power- law 
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behaviour of the cluster-size distribution characterizing self-propelled rods was also discussed 
extensively in recent more detailed simulations of self-propelled rods |368| . where exponents of 
the weighted cluster-size distributions are in the range between 0.95 and 1.4. Interestingly, also 
recent experiments with bacteria, namely Bacillus subtilis |374j and a mutant of Myxococcus 
xanthus |270j report exponents c of the weighted cluster size distribution in the range of 0.85-0.9 
. We expect further theoretical and experimental activities, that may finally uncover universal 
properties in the clustering of self-propelled rods and related systems. 

In summary, one finds non-equilibrium clustering for interacting self-propelled rod shaped- 
particles with sufficient packing density rj and aspect ratio k in simulations. The onset of 
clustering can be defined by a transition from a unimodal to bimodal cluster size distribution. 
This transition is reproduced by a mean-field description of the cluster size distribution, which 
yielded a simple criterion, k ~ C/?7 — 1, for the onset of clustering. It is instructive to compare 
these results rewritten in the form K-q -\- rj k, 1.46 with the formula for the isotropic- nematic 
transition n-q « 4.7 found in the two-dimensional version |184| of Onsager's mean-field theory for 
Brownian rods |248| . This shows that actively moving rods can achieve alignment at much lower 
densities than Brownian rods resp. particles in equilibrium systems. The clustering phenomenon 
is absent in simulations with isotropic self-propelled particles as well as with Brownian rods. 
The model of self-propelled rods provides also an alternative explanation for collective behavior 
of rod-shaped objects - previous swarming models have achieved aggregation and clustering 
by assuming attractive long-range interactions |354ll42lll6lll4j . With respect to biology, the 
observations made for self-propelled rods offer a physical explanation for the formation of 
clusters in many gliding rod-shaped bacteria, that often precedes the formation of biofilms and 
the appearance of more complex patterns. 

7.3.2 Clustering of self-propelled particles with velocity alignment 

In the following, the interplay between orientation ordering by velocity alignment and clustering 
in self-propelled particles with ferromagnetic F- or nematic LC-alignment is analyzed and 
briefly discussed. Through simulations evidence was provided that at high density orientation 
ordering sets in before clustering j265j . In contrast, for low particle densities, the onset of 
orientation ordering and clustering are closely related and seem to occur at the same value of 
the noise [265 269 for LC-alignment. These findings indicate that the phase transition occurs 
rather due to mixing of particles than exclusively to the directed active motion. 

In Fig. ISSTa) the behavior of the orientational order parameters S^'~^ and S^'^ vs. the 
noise amplitude ?/ for high density is shown for a model with LC-alignment. A transition from 
a disordered (isotropic) to an orientational ordered (nematic) state is strongly suggested by 
the simulation data. Close to the critical noise amplitude 77c the scaling of the curve follows 
the scaling predicted by the mean field outlined in section 4 |267j . The departure from the 
mean-field prediction occurs exactly when the spatial distribution of particles can not longer 
be considered homogeneous, compare snapshots Fig.lSSlb-d). Note, also that the ferromagnetic 
order parameter is zero as long as the density appears spatially homogeneous. At low density 
the scenario how orientational order emerges is significantly different. Fig. IBgT a) shows that for 
p = 0.25 the dependency of the orientational order parameter 5' on the noise amplitude 77 is 
qualitatively different from the one observed at high density. The second remarkable difference 
is that the apparent onset of orientational ordering coincides with the onset of clustering. This 
is also confirmed by the cluster size distribution which exhibits a power-law distribution near 
the onset of orientational ordering |269| . Fig. IBgT b) shows that for zero orientational order the 
spatial distribution of particle is roughly homogeneous. As soon as clustering is observed in 
the snapshots, see Fig. IMT c). the order parameter starts to deviate from zero. As the noise is 
decreased clustering effects are more pronounced, Fig.|69|d). The displayed patterns correspond 
to typical particle configurations in a quasi-steady steady state. In particular, the pattern of 
cluster does not coarsen as in a phase separation process. Here, clusters form and disintegrate 
in a dynamical way. The rate of growth and disintegration of the clusters is highly dependent 
on the value of rj. Given a value of 77 the cluster size distribution reaches a steady distribution 
after an initial transient similar to the behaviour of self-propelled rods described above. 
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Fig. 68. Orientational dynamics and clustering at high density. Number of particles N = 2 and 
density p = 4. (a) Orientation order parameter 5* vs. noise amplitude rj. Symbols are average over 10 
realizations. The dashed curve corresponds to the scaling predicted by the mean-field while the vertical 
dot-dashed line indicates the onset of clustering effects, (b)-(c) snapshots of the simulations for the 
values of rj indicated in (a) at the steady state, time step 2.5 10^. [265j 




Fig. 69. Orientational dynamics and clustering at low density. Number of particles A*' = 2^^ and 
density p = 0.25. (a) Orientational order parameter 5* vs. directional noise amplitude rj. Symbols are 
average over 10 realizations. The dashed curve corresponds to the best fit of the simulation data close 
to i]c- (b)-(c) snapshots of the simulations for the values of rj indicated in (a) at the steady state, time 
step 2.5 lO'^ [265]. 
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In the following, a simple theory to understand the emergence of steady state cluster size 
distributions in self-propelled particle systems with velocity alignment. The treatment is anal- 
ogous to the one described above for the cluster-size distribution of self-propelled rods. The 
dynamics of the cluster-size distribution may alternatively be described by deriving a master 
equation for the evolution of the probability p(n[t)), where n(t) = ni{t),n2{t)^ ...^riNit), with 
ni{t) being the number of isolated particles, n2{t) the number of two-particle clusters, n3(t) 
the number of three-particle clusters, etc. This kind of approach has previously been used to 
understand equilibrium nucleation in gases, where the transition probabilities between states 
are function of the associated free energy change [30413111312] . Here, equations for the time 
evolution of the values of ni{t), n2{t), nN{t) are derived to describe the cluster dynamics. To 
simplify the notation, one refer to {ni(t)), {n2{t)), (riAr(t)) simply as ni(t), n2(t), etc. The 
time evolution equations for the ni(t) obey the following form: 

N N-l 

hi = 2B2^^2 + ^ BkUu - ^ Aksnmi 

k=3 k=l 
N-] 

hj = Bj+iUj+i - BjTij - AkjUkUj 

k=l 

1 

+ -;; ^ Akj-knknj-k for j = 2, , iV - 1 
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Bnum + \'Y Ak,N-knknN-k (424) 
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where the dot denotes the time derivative, Bj represents the rate for a cluster of mass j to 
loose a particle, and is defined as 

B^-^Vj^ (425) 
and Aj^k is the collision rate between clusters of mass j and fc, defined by 

VQ2e 



A 



j.k 



(V7 + Vfc) , (426) 



where a = is the area of the two-dimensional space where particles move. In Eq. (|425p . 
d denotes, the maximum distance that two particles can be separated apart to be considered 
as connected and part of the same cluster The expression d^ / Dcs{i]) is an estimate for the 
characteristic time a particle spends at the boundary before it moves away from the cluster. 
The splitting rate Bj is proportional to the inverse of this characteristic time multiplied by the 
number of particles on the boundary, which is estimated as v^J ■ On the other hand, the collision 
rate Aj^k is derived in analogy to the collision rate in kinetic gas theory between two disk-like 
particles A and B 



Numerical integration of these equations shows that Eq. (|424p produces qualitatively similar 
distributions as the one observed in individual-based simulations, see [269] . The different curves 

correspond to various values of the dimcnsionless parameter P, defined as P = -^^rj^- For 
small values of P, which correspond to large values of 77. the distribution p(m) monotonically 
decreases with m. while for large values of P, resp. small values of i], a peak at large cluster 
sizes emerges. A quantitative comparison between Ea. (|424p and individual-based simulations 



is still in a very early stage [269]. 

Altogether, polars clusters play a fundamental role in the macroscopic dynamics of self- 
propelled particle systems. Orientational order and cluster dynamics are often closely linked. 
The cluster size distribution can be obtained from a set of equations of the Smoluchowski type 
to describe the cluster dynamics in the system. Its usefulness awaits further test by comparison 
to simulations and experiments in systems of self-propelled units. 
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Fig. 70. Steady state cluster size distributions obtained from numerical integration of Eas. (|424|) with 
A'' = 128 for various values of the dimensionless parameter P, where P — -^r—i^. Notice the transition 
from a monotonically decreasing distribution for small values of P to a non-monotonic distribution 
with a peak at large cluster sizes for large values of P. 

7.4 Large-scale segregation bands 

Segregation bands arc coherent structures typically seen in large-scale simulation of self-propelled 
particle systems with velocity alignment |354l59ll36j . These bands often represent high-density 
zones with a high degree of orientational order embedded in a low-density background with 
orientational disorder. This coupling of orientational order and density goes beyond the mean- 
field theories describing the onset of orientational order in systems with homogeneous density 
that were introduced in the previous section. Extensive simulation studies have revealed a clear 
correlation between the appearance of travelling segregation bands and the observation of a 
first-order transition to orientational order in Vicsek model |59j . that was first reported in 

m- 

Some examples for the segregation bands in the Vicsek model are displayed in Fig. [7TJ The 
segregation bands in the Vicsek-models consist of many particles that are roughly aligned and 
travel mostly orthogonal to the edge of the band. Recently, improved mean-field theories were 
able to reproduce the simultaneous occurrence of segregation band and orientational order as 
well as the correct relation between the traveling [35 37 234. 

An exhaustive discussion of these phenomena in the Vicsek model can be found, e. g. in 

A recent study of the Peruani model addresses the collective properties of self-propelled 
particles with nematic interaction (LC-alignment). Extensive simulations have revealed long- 
range nematic order, phase separation, and space-time chaos mediated by large-scale segregated 
structures, which we will describe low in greater detail |136) . 

The simplicity of this model allowed to deal with large numbers of particles, revealing 
a phenomenology previously unseen in more complicated models sharing the same symme- 
tries [26612021362] . where mostly clustering phenomena were reported. The two-dimensional 
simulation study showed large-scale segregation bands distinctively different from both those 
of the polar-ferromagnetic (F-alignment) case of the Vicsek model and of active nematics. Seg- 
regation appeared as a phase separation into high and low density areas: in the ordered side, a 
dense band occupying a fraction of space along which particles move in both directions arises 
when noise is strong enough. Remarkably, the instability marks the order/disorder transition. 
It vanishes at strong noise, splitting the disordered phase in two. The class of polar particles 
aligning nematically exhibits thus a total of four phases. Polar and nematic order in the model 
with LC-alignment can be characterized by means of the two time-dependent global scalar order 
parameters P{t) = \{exp{i9j))j\ (polar) and S{t) = \{exp{i26j))j\ (nematic), as well as their 
asymptotic time averages P = {P{t))t and S = {S{t))t- A brief survey of the stationary states 
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Fig. 71. Typical snapshots in the ordered phase obtained from simulations of the Vicsek-model. 
Points represent the position of individual particles and the red arrow points along the global direction 
of motion. (a,b) Vicsek model with angular noise and increasing system size. ( c) bands in simulation of 
Vicsek-model with angular noise, repulsive force, and periodic boundary conditions, (d) High-density 
sheet traveling in a three-dimensional box with periodic boundary conditions and angular noise. All 
figures from |59] . 



observed in a square domain is provided in Figs. 1721 Despite the polar nature of the particles, 
only nematic oricntational order arises at low noise, while P always remains near zero. Both 
the ordered and the disordered regimes are subdivided in two phases, one that is spatially ho- 
mogeneous (Figs. IT^ a.e')). and one where density segregation occurs, leading to high-density 
ordered bands along which the particles move back and forth (Figs. [ZSKb-d)). A total of four 
phases was observed, labeled I to IV by increasing noise strength hereafter. Phases I and II are 
nematically ordered, phases III and IV are disordered. 

Phase I, present at the lowest rj values, is ordered and spatially homogeneous (Fig. [72k'). 
Phase II differs from phase I by the presence, in the steady-state, of a low-density disordered 
region. In large-enough systems, a narrow, low density channel emerges rather suddenly, like 
in a nucleation process (Fig. [72b). It becomes wider at larger ry values, so that one can then 
speak of a high-density ordered band, typically oriented along one of the main axes of the 
box, amidst a low-density disordered background (Fig. |75J;). Particles travel along the high- 
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(a) 





(e) 



IV 

Fig. 72. (color online) (a-c) Typical steady-state snapshots at different noise values (linear size L = 
2048). (a) ri = 0.08, (b) 77 = 0.10, (c) 77 = 0.13, (d) ri = 0.168, (e) 77 = 0.20. Arrows indicate the polar 
orientation of particles (except in (d)); only a fraction of the particles are shown for clarity reasons. 
For a movie corresponding to (d) see suppl. material of [136) . 
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Fig. 73. (color online) Phase II (stable bands) (a) Rescaled transverse profiles in square domains of 
linear size. Data averaged over the longitudinal direction and time, translated to be centered at the 
same location. Bottom; density profiles. Top: nematic order parameter profiles, (b) Surface fraction SI 
as a function of rj (defined here as the mid-height width of the rescaled S profile) [136) 



density band, turning around or leaving the band from time to time. Within the band, nematic 
order with properties similar to those of phase I is found (slow decay of S with system size, 
giant number fluctuations). The (rescaled) band possesses a well-defined profile with sharper 
and sharper edges as L increases (Fig. [75k). The fraction area f2 occupied by the band is 
asymptotically independent of system size and decreases continuously as the noise strength rj 
increases (Fig. [73}d). 

In phase III, spontaneous segregation into bands still occurs (for large-enough domains), 
however these thinner bands are unstable and constantly bend, break, reform, and merge, in 
an unending spectacular display of space-time chaos (Fig. 17^). Thus, the transition between 
phase II and III, located near Tyn-m ~ 0.163(1), is the order-disorder transition of the model. 
It resembles a long wavelength transversal instability of the band (see for instance Fig. [7^ . 

Increasing further the noise strength, the segregated bands vanish, leaving phase IV, an or- 
dinary disordered phase, spatially-homogeneous, and with very short correlations in space and 
time (Fig. 17^). Near the transition point, at r^m-iv — 0.169(1), the nematic order parameter 
S{t) exhibits bistability between a low amplitude, fast fluctuating state (typical of phase IV) 
and a larger amplitude, slowly fluctuating one typical of phase III [136) . This suggests a dis- 
continuous disorder-disorder transition between phase III and IV for the Peruani model similar 
to the above cited results for the Vicsek-model. 

Note also that the above results, and in particular the space-time chaotic motion of the 
spontaneously segregated bands (phase III) (see supp. material in |136) ). are reminiscent of the 
streaming and swirling regime which characterizes the aggregation of myxobacteria jl74ll81l375] . 
The model results suggests that no adhesion or chemical signaling is needed for such behavior to 
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Fig. 74. Phase III (unstable bands, r] = 0168). Snapshot of coarse-grained density field during the 
growth of the instability of an initially straight band in a 4:1 aspect ratio rectangular domain. 



emerge, LC alignment mediated by volume-exclusion interaction is sufficient to obtain complex 
patterns. These results may therefore be relevant for the collective dynamics of gliding bacteria, 
biofilms and other cells with friction and moderate adhesion. 

At a more general level, the findings reveal unexpected emergent behavior among the sim- 
plest situations giving rise to collective motion. The described model of self-propelled polar 
objects aligning nematically stands out as a member of a universality class distinct from both 
that of the Vicsck model |354I342I^ and that of active nematics [SO]. Thus, in the out-of- 
equilibrium context of self-propelled particles, the symmetries of the moving particles and of 
their alignment interactions must be considered separately and are both relevant ingredients. 
A major lesson of the discovery of large-scale separation bands of different symmetries for the 
models with F- and LC-alignment is that mean-field and other continuum theories have to 
be extended to allow for density instabilities. Improved continuum models should eventually 
reproduce the behaviour found in large-scale simulation, first promising steps in this direction 
has been provided by Bertin et al. [37] and Mishra et al. |234) . 



8 Discussion, Outlook and Conclusions 

The first systematic studies of systems far from equilibrium and their surprising self-organizing 
capabilities date back more than half a century back and are connected to such distinguished 
scientists as Alan Turing, Ilya Prigogine or Hermann Haken. The ideas and concepts formu- 
lated and introduced by this scientific pioneers inspired generations of statistical physicists and 
applied mathematicians to pursue their research on corresponding problems with applications 
to physics, chemistry and biology. 

Recently, a subclass of such far from equilibrium systems, characterized by active motion of 
individuals units, received growing attention. The continuously increasing number of publica- 
tions on such systems, are probably the best proof for an intense and ongoing research activity. 
The individual active units may be of very different type and the relevant spatial length scales 
may span over many orders of magnitude starting from the nanometer scale governing the 
motion of individual molecular motors to kilometers in the case of large collectively moving 
swarms of insects, such as desert locusts. Despite this apparent heterogeneity of active systems, 
the common fundamental properties and universal dynamical features, suggest the formulation 
of generic models of active motion within the framework of dynamical and stochastic systems. 
The mathematical description based on the concept of individual active particles, allows on 
the one hand the detailed understanding of the dynamics of individual units constituting an 
active system and on the other hand enables us in a simplified setting to derive coarse-grained 
equations and to study the large-scale behavior of "active matter" systems. Here, the focus lies 
on the rather simple models, which in the ideal case provide qualitative insights to the universal 
dynamics and allow often for analytical treatment at the costs of quantitative predicitive power 
of specific active matter realizations. 

In Sections [3] and |3] wc have introduced the mathematical framework for the description of 
self-propelled motion of individual Brownian particles and analyzed the behavior of a number 
of different models. We discussed the concept of active Brownian motion and its description via 
velocity-dependent friction functions based on the assumption of an internal degree of freedom 
of individual particles (energy depot) or as an effective description of ensembles of coupled 
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active particles (molecular motors). Here, we did not restrict ourselves to the case of Gaussian 
fluctuations, but discussed difl'erent types of stochastic forces, such as dichotomous Markov 
noise or shot-noise, and their impact on the system dynamics. Based on the non-equilibrium 
nature of the studied dynamics, we addressed the question of the different impact of active 
and passive fluctuations and have shown that active fluctuations, which are correlated with the 
direction of motion of individual particles lead to characteristic deviations of the corresponding 
speed and velocity distributions, independent on model details, such as a particular choice of 
the friction function. 

Furthermore we analyzed the diffusive motion of free active particles (Sec. S]) and their 
dynamics in external confinements (Sec. [5]). The detailed analysis of the individual dynamics 
reveals surprising features of active Brownian motion such as a giant diffusion regimes or optimal 
noise values, which maximize or minimize the spatial diffusion. 

In the last two sections we have extended our analysis to "swarms" and "gases" of inter- 
acting active particles. In Sec. [SJ we identified for example the fundamental stationary modes 
of collective motion of active Brownian particles with attracting interactions (swarms) and dis- 
cussed novel results on the complex behavior of swarms with attraction and repulsion in three 
spatial dimensions. 

An important class of interactions studied in the literature is the so-called velocity-alignment, 
which we put a particular emphasis on in Sec. [51 We have shown how, starting from microscopic 
Langevin equations of active Brownian particles with polar velocity alignment, we can derive 
systematically the corresponding mean field equations. We then focus on the onset of order in 
the special class of minimal models of self-propelled particles, with polar and apolar alignment 
interaction, motivated by the well known Vicsck-model. 

Finally, we have discussed pattern formation in such minimal models, which show features 
such as clustering and formations of large scale density inhomogeneities in Sec. [71 This patterns 
are intrinsically connected to the active motion of the interacting units and the onset of large- 
scale collective motion, and are up to date under intense investigation. 

Despite our focus on qualitative understanding, the comparison with experimental results 
of active matter systems and corresponding modelling approaches, which were motivated by 
those, must not be neglected. 

Individual Dynamics - Experiments and Models 

The most obvious example of autonomous self-propelled motion, which does not require exter- 
nal driving, is the motile behavior of biological agents. Here, the single-celled motile organism, 
such as certain bacteria or eukaryotic cells (e.g. Dictyostelium discoideum) are probably what 
comes closest to the concept of an "active Brownian particle" as discussed in this review. How- 
ever, being "simple" in comparison to higher organisms, does not mean that the corresponding 
mechanisms of active motion is not complex. In fact, in recent decades we witnessed a burst in 
scientific advances which pushed forward our understanding of cell motility. The active translo- 
cation of cells is driven by complex dynamics of the intracellular actin cytoskeleton (see e.g. 
[236]). It is a fascinating field of interdisciplinary research already for decades, which continues 
to thrive and continuously motivates theoretical investigations (see e.g |198ll34ll07j and recent 
reviews }121ll78j l 

Bacteria, for example, can exhibit different motility types to propel themselves under difl'er- 
ent environmental conditions |105ll86j . Probably the best understood bacterial motility type is 
swimming in a liquid medium due to the action of rotating fiagella [32I323| . The typical bacte- 
rial swimming motion consists of straight runs interrupted by short reorientation events. This 
so-called "run & tumble" motion has been successfully modelled by a random walk approach 
[31I62| , where usually constant speed and Poissonian distribution of reorientation events is as- 
sumed. However, a closer look at some real trajectories reveals that in between the tumbles a 
bacterium does not move in a perfect straight line with constant speed [237^ . Brownian fluctu- 
ations as well as possible fluctuation in the driving force lead to more complicated dynamics. 
Thus, a more realistic model can be obtained by a combination of a Langevin description, as 
discussed in this review, together with tumbling dynamics, as suggested by Condat et al. [55] . 



142 



Will be inserted by the editor 



Yet the authors considered in their model only passive fluctuations and a consideration of active 
fluctuations (Sec. 13. 3[) will yield different results. 

Swimming of bacteria, as well as other microorganisms (e.g. microalgae [87]), takes place at 
extremely low Reynolds numbers (^ 10~^) and a large number of theoretical studies investi- 
gated the active motility of swimmers using an overdamped hydrodynamical description (Stokes 
equation) which takes into account interactions between the active swimmer and the fluid. This 
approach yields some interesting preditions on long-ranged hydrodynamical coupling between 
different swimmers as well as between cells and surfaces (see e.g. jl58l205l7l272ll59l276| . or a re- 
cent review in |206j ). However, recent a recent experiments with E. Coli conducted by Drescher 
et al. |86] . show that in most cases the effects of long-ranged hydrodynamic interactions are 
negligible in comparison to the intrinsic stochasticity in the motion of bacteria (i.e. rotational 
diffusion). Thus, the authors conclude that the collective dynamics of bacteria might be quite 
similar to the dynamics exhibited for example by granular systems. Based on this surprising 
results, Langevin equations may be an interesting modeling alternative, as they allow for simple 
implementation of various interactions (see Section and |72I28I29^ ). 

A common objection against bacterial equations of motion of the Langevin type are negli- 
gible inertial effects due to the extremely low Reynolds numbers at which the dynamics takes 
place. However, second-order equations of motion may offer a suitable effective description in 
the presence of additional time scale(s) in the propulsion mechanism and the resulting bacterial 
response to external signals, as for example to gradients of chemical agents in their environ- 
ment (chemotaxis). Furthermore, Langevin equations can provide a reasonable framework for 
modelling other motility types observed in bacteria, such as twitching or gliding. In particular 
in cases where the shortest time-scales - where the details of the specific propulsion mechanism 
play an important role - are not of interest. 

We have only briefly discussed chemotactic behavior in the context of collective dynamics 
in Section [6.3.21 For a more detailed discussion on chemotaxis, we refer the interested reader 
to the rich literature on this fascinating topic j34l223ll05l358ll69] . 

In recent years, there has been a number of empirical studies analyzing the motion of 
various eukaryotic cells crawling on substrates |314I81I212I313I41I211| . All these studies have 
shown that the Ornstein-Uhlenbeck model of persistent Brownian motion is not sufficient to 
explain the empirical observation, but differ in their conclusions. Dieterich et al. [81] suggest the 
description of the cell migration by a fractional Klein-Kramers equation, in order to explain the 
observed anomalous dynamics. However, this conclusion have been questioned as the apparent 
super-diffusive behavior may be a consequence of too short observation times with respect to 
possible long relaxation times of the direction of motion of individual cells j268l53l2TT| . 

The analysis of the deterministic and stochastic accelerations derived from the tracking 
data in [31413131411211] . show similar behavior for different cells types: 1) a negative linear 
drift which corresponds to constant Stokes friction, and 2 ) fluctuations strengths increasing 
with the speed of the cell, which indicates multiplicative noise in the corresponding Langevin 
equation. 

Researchers around Henrik Flyvbjerg and Edward C. Cox, have carefully analyzed the 
experimental trajectories of different cell types and proposed different models of persistent 
motion using Langevin equations based on their empirical findings. For human epidermal cells, 
they formulated stochastic intcgro-differential equation of motion with a kernel representing a 
short-ranged memory of the cell [3141313] . Hereby, they motivated their choice with the double- 
exponential decay of the cell velocity autocorrelation. This however can be also explained by a 
simper model with independent fluctuations in the velocity and direction of motion as proposed 
by Peruani and MorcUi [268] and discussed in Sec. 14.3.21 The same group also analyzed the 
motion of Dictyostelium discoideum amoeba, and have shown that its motion consists of two 
components: a persistent stochastic motion and a fast oscillatory contribution. This oscillatory 
dynamics at short time-scales can be linked to the specific propulsion mechanism. The cells 
move forward by growing protrusions at their leading edge, so-called pseudopods, attaching 
them to the substrate and "pulling" themselves forward by contracting their trailing edge. A 
repeated right-left-right-left formation of such pseudopods leads to a zig-zag motion responsible 
for the oscillatory contribution [3131212] . Similar observations have been reported previously by 
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Shcnderov and Sheetz }316j . and just recently by Yang ct al. |366j . In fact, oscillatory dynamics 
arc not restricted to Dictyostelium amoeba, but have been reported by Barnhart et al. |18| in 
motile fish keratocytes. The authors use a modelling approach to show, that such oscillation 
may be explained by the effective elastic coupling of the different parts of the cells, in particular 
the leading and trailing edges. 

Only recently, Zaburdaev et al. |373j investigated the swimming motion of the parasite 
African tryponosome. Based on similar analysis of empirical data as discussed above for eu- 
karyotcs, the authors propose a Langevin model of its motion. In their model, the authors 
distinguish a slow velocity component, characterized by a constant speed and subject only to 
rotational diffusion and an additive fluctuating component with linear relaxation. Essentially, 
this corresponds to an active Brownian particle, with a Schicnbein-Gruler friction function as 
discussed in Sec. 13.31 with active and passive fluctuation terms, corresponding to the angular 
diffusion of the slow component and the vectorial noise in the fast component, respectively. 

The Langevin models based on velocity-dependent friction function as discussed in this 
review, can not account for the specific details of active motion of crawling cells such as the 
observed oscillating dynamics on short time-scales. However, they yield a simple description 
at longer temporal and spatial scales, where such fast and typically small oscillatory motion 
can be neglected or considered as an additional quasi-stochastic contribution to the dynamical 
behavior. 

We have introduced and discussed in Sec. 12.31 and 13.41 "internal coordinates" , a co-moving 
coordinate system determined by the propulsion and symmetries of the active particle. Based 
on empirical investigation of cell trajectories, Li et al. emphasize in [211) the importance of 
using such a coordinate system attached to the cell instead of the laboratory reference frame. 

Zooplankton species, such as Daphnia, represent another example of actively moving biologi- 
cal agents, which are currently investigated due their ecological importance (see e.g. [357 63 25 0,115I128I76I2?7] ). 
Daphnia motion consists of straight hops interrupted by turning events with exponentially dis- 
tributed turning angles |115ll28j and can be modelled as a persistent random walk (see Sec. 
m and [1951128] ). Frank Moss and coworkers advocated the theory that the specific motion 
pattern of Daphnia is the results of evolutionary adaptation to foraging in finite food patches. 
Although this hypothesis is difficult to prove, it is at least consistent with various empirical 
observations [128I77| . 

An example of non-living active Brownian particles are the autonomously moving micro- 
and nanoscale particles which convert chemical energy into kinetic energy of motion (see e.g. 
[173I260I164I185I233I194] or a recent reviews in [92I135| ). One general mechanism of self- 
propelled motion of these objects is so-called self-phoresis. In general, phoresis refers to the 
effective transport of colloids due to boundary layer forces induced by external fields [8]. For 
example, diffusiophoresis refers to a drift experienced by a colloidal particle subject to concen- 
tration gradient across its interface. Self-phoresis is thus the phenomenon, where the change 
in the environment which leads to phoretic drift (e. g. formation of a concentration gradient) 
is induced by the particle itself. Self-propulsion can be achieved by an breaking the symme- 
try in the ability to catalyze some "fuel" substance on its surface. For example platinum is a 
catalyst for the decomposition of hydrogen peroxide (II2O2) into oxygen and water. A particle 
half-coated with platinum in a fiuid containing II2O2 will perform self-propelled motion with 
a speed depending on the concentration of II2O2 [16413491185] . This was theoretically inves- 
tigated using simplified models by Golestanian et al [1381139] . as well as detailed molecular 
dynamics simulations by Kapral and co-workers [2951335] . 

The first experimental realization of such systems, triggered a surge of research on catalytic 
self-propelled particles. For example, it was shown that these objects can transport cargo [331] . 
or can be effectively controlled by external (e.g. magnetic) fields [340] . 

The propulsion direction set via the self-phoresis asymmetry, defines the preferred direction 
of motion (heading) [185193] as introduced in Sec. 12.31 & 13.31 Due to their small size, the 
particles are subject to Brownian fiuctuations, but in addition we expect that non-thermal 
fluctuations associated with the non-equilibrium propulsion will contribute to the stochasticity 
in their motion. Thus, these object, as well as related autonomous swimmers appear as very 
good candidates for polar active particles with passive and active fluctuations as introduced 
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in Sec. 13.31 In addition, it is possible that for non-sperical but axis-symmetric particles, a 
mis-alignment of the self-phoresis symetry axis with the "body axis" will introduce systematic 
torques into the dynamics of active particles as discussed in Sec. 14.3.51 and in |360j . 

Another interesting application of such chemically driven particles is the fabrication of nano- 
rotors by attaching the particles to a substrate |122l233j . which can be described by a simple 
models of confined active Brownian particles discussed in Sec. [S] 

Interestingly, the Cartesian velocity histograms of both, freely moving cells and artificial self- 
propelled particles are non-Gaussian and show increasing counts at low velocities (low speeds) 
[2121411185] . In Sec. 13.2.1] and [331 we have shown that this behavior is generic in the presence 
of active fluctuations. Hereby, the deviation from a Gaussian probability distribution function 
at low velocities increases with increasing strength of active fluctuations. In fact, similar effect 
can be observed for oscillatory self-propulsion as discussed in Sec. 13.1.71 1290] . 

It appears that the concept of Active Brownian particles, is even better suited as a general 
model of such autonomously moving artificial objects than for the motion of biological agents 
due to the simpler propulsion mechanism. We believe it may contribute significantly to the 
understanding of the active diffusion of these self-propelled particles, as well as their behavior 
in external fields. 



Collective Dynamics - Experiments and Models 

Experimental examples for collective dynamics and pattern formation of active particles are 
often found during the life cylces of bacteria or other microorganism like Dictyostelium dis- 
coideum (Dd) |28| . While aggregation and patterns in Dd cells are mostly driven by chemo- 
taxis, i. e. motility responses to a chemoattractant generated by the cells itself, other organisms 
like myxobacteria jlSlj provide intriguing examples of self-organization of active, self-propelled 
objects. In contrast to processes controlled and influenced strongly by biochemical communica- 
tion between the active agents (= cells), more recently experiments with swimming and gliding 
bacteria have been performed that focus on the interaction between active motion and simple 
physical interactions. 

Swarming behavior in colonies of up to a thousand swimming bacteria Bacillus subtilis have 
been investigated by Zhang and coworkers [374[ . Their setup allowed to locate the individual 
cells and determine their directions of motion. As a result, Zhang et al. could determine the num- 
ber fluctuations as well as the cluster size statistics of the bacterial swarms. They found cluster 
size distributions similar to the ones reported for the self-propelled rod models for densities 
below the nonequilibrium clustering transition in Section 7 above, i. e. the identified distribu- 
tions of a form P{n) oc n^''e^"/"^ where n denotes the cluster size and nc a density-dependent 
fit parameter. The exponent b was density independent and took on a value of 6 = 1.85. In 
parallel, Zhang et al. report giant number fiuctuations for the standard deviation of the particle 
numbers Aj^ oc A^" with an exponent a near 0.75 for small mean cell numbers A'^. These giant 
number fluctuations are presumably linked to the formation of larger clusters of cells moving in 
the same direction. In more recent work, Peruani et al. analyzed the collective motion of up to 
two thousand gliding bacteria in a two-dimensional monolayer. The organism under study was 
a mutant species of Myxococcus Xanthus that does no possess flagella and does not exchange 
biochemical signals relevant for the control of their motility |270| . Experiments were conducted 
over a large range of densities. As a result a transition to nonequilibrium clustering was found 
at a critical coverages of around 16 percent. The cluster size distribution at the transition be- 
came a power law with exponent b — 1.88 and a pronounced second maximum was found at 
large cluster sizes for densities above the critical value. In addition giant number fluctuations 
with exponent a ~ 0.8 were found. It is striking that quite different bacterial systems (gliding 
myxobacteria and swimming Bacillus subtilis) exhibit similar clustering dynamics and related 
giant number fluctuations. If we recall that the cluster size distribution P{n) discussed here is 
related to the weighted cluster size distribution p{n) = nP{n), we immediately get a relation 
b = 1 + c, where c is the exponent of the cluster size distribution discussed in Subsection 7.3 
above. The exponents c « 0.9 [266j and a c in the range of 0.9 1.3 |368| . This suggests that 
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collective dynamics of some bacterial species may be indeed well described by self-propelled 
rod-shaped particles with volume exclusion interactions. 

Another experimental system, wherein spectacular experimental phenomena were observed, 
is a motility assay with actin filament, ATP and immobilized molecular motors [298] . Below a 
critical density of ca. 5 filaments per square micrometre, a disordered phase with no preferred 
orientation is observed in these experiments. Above, the critical density different ordered pat- 
terns are observed. First moving clusters of filaments are observed similar to the observation 
presented for self-propelled rods. Above a second threshold of 20 filaments per square microme- 
tre traveling density bands are observed similar to the ones found in the Vicsek model, i. e. high 
density traveling waves (or bands) composed of aligned filaments that travel individually in the 
some direction of motion as the whole wave. These bands are reminiscent of the observation 
in simulation presented in Fig. 71. Schaller et al. were able to reproduce their experimental 
findings in a cellular model that was based on similar assumptions as the simple models for 
collective motion discussed in Section 6 and 7 |298j . In parallel, swirling vortex-like motion 
states were also observed in the whole above the first critical density of ca. 5 filaments per 
square micrometre. In a related study with a motility assay that contained filaments, ATP, mo- 
tors and crosslinking proteins, Kohler et al. report pattern formation characterized by a broad 
distribution of cluster sizes |193] . With time a coarsening of these clusters and a related higher 
percentage of large clusters was observed. A detailed quantitative analysis of the cluster sizes 
was not carried out. Hence, only future experiments will show if the cluster size distributions 
will follow similar laws as the ones reported above for similar of collective motion of active par- 
ticles. A class of physical systems that realize self-propelled particles are ensembles of driven 
granular particles with asymmetric shape and weight distribution. Kudrolli et al. studied cylin- 
drical rod-shaped particles with strongly asymmetric weight distribution and reported local 
ordering as well as a strong tendency to aggregation and persistent swirling motion in which 
velocities are strongly correlated with particle orientation |202| . The findings agree quite well 
with simulations of self-propelled system, where Wensink et al. have also reported aggregation 
of rods near the boundary |362j . 

Another experimental realization of collective motion in granular particles was designed by 
Deseigne at al. |80| . who studied vibrated polar discs {— discs with asymmetric material density) 
in a system with a petal-shaped boundary. This particular shape avoids the aggregation of 
particles at the boundary and leads to more homogeneous distributions of the moving particles. 
The experiments then yields orientational order and giant number fluctuations with exponent 
a ~ 0.725. This is again in the ballpark of the observation for the simple models discussed in 
Section 7 as well as similar to the values measured for bacterial swarms above. 

Altogether, simulations of models describing the motion of active Brownian particles and 
their interactions are in good agreement with many recent findings for living systems such as 
bacteria, in-vitro biological systems like motility assays and driven granular matter. One is 
tempted to look for universal properties of such systems. There is however a large plethora of 
patterns that cannot be reproduced from the simple assumption discussed in extenso in this 
review. For such systems, the models analyzed and described may nevertheless provide good 
starting points in model developments. 

Bacterial colonies and social amoeba as discussed above, are by far not the only biological 
systems exhibiting collective motion on large scales. In fact, colloquially a "swarm" is typically 
associated with collective motion of higher organisms such as, flocks of birds, schools of fish, or 
the devastating mass migration of insects (e.g. desert locusts). Up to recently, experimental data 
on the individual behavior and collective motion patterns was rather limited |247ll97j . As a 
consequence most models of collective motion motivated by the different swarming phenomena 
relied on more or less empirically based assumptions and qualitative matching of the model 
behavior with empirical observations (see e.g. |10l281l70l257l40j and further references in Sec. 
ini). Most of these models share the following three interactions mechanisms: 1) short-ranged 
repulsion responsible for collision avoidance, 2) long-ranged attraction ensuring group cohesion 
and 3) directional alignment (typically at intermediate distances) facilitating collective motion 
of the group. These type of models is usually referred to as zone-models. Many of these models 
assume for simplicity constant speed of individuals. 
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However, new experimental methods, such as automated digital video recordings, allow the 
collection of large data sets. This enables not only the statistical analysis of collective motion in 
nature [SD] but allows also to infer the interaction rules between individuals [17 55.220.183 1 57 . 

Based on careful analysis of experimental recordings of starling flocks and the resulting 
correlation functions, Ballerini et al. |17j have shown that each individual responds on average 
to the behavior with a fixed number of its nearest neighbors. Thus, they conclude that the 
interaction between individual birds is governed primarily by the topological distance and not 
the metric distance as assumed in most theoretical models also those discussed in Sec. IHl This 
feature of the interactions offers a simple explanation for large density differences observed 
between different flocks and may also contribute to the robustness of cohesive bird flocks with 
respect to external pertubations (e.g. predators). In a follow-up work, Cavagna et al. |54| report 
scale-free fluctuations in starling flocks, which may indicate the operation of the flock close to 
criticality. Being close to a critical point may be advantageous for a swarm or flock acting as a 
collective information processing system |330I238I352| . 

Lukeman et al. |220| have collected and analyzed data on collective behavior of surf scoters 
swimming on the water surface. The authors fit their data to a zone model, identify the best 
parameter values and argue that the standard zone model has to be complemented by an 
additional interaction to the front. 

Very recently two studies have appeared, which infer the social interaction rules between 
fish [1831157] . Both studies report that speed modulation is the primary response to close by 
individuals in front or in the back. This speeding up/slowing down as well as turning behavior 
of the fish are consistent with an attraction-repulsion behavior but show no clear evidence for 
directional alignment. In addition Katz et al. [183] report that the three fish interaction is 
neither given by a superposition nor an averaging of pairwise-interactions, whereas Herbert- 
Read et al. |157| stress the importance of the interactions with the nearest neighbor. 

In the light of these recent results, the active Brownian particle concept appears as a promis- 
ing starting point for the development of more realistic models of collective motion as it 1) 
naturally accounts for a variable velocity of individuals and acceleration/deceleration due to 
effective forces, and 2) exhibits collective motion for simple attraction/repulsion interactions 
without need of alignment terms as discussed in Sec I6.1l and l6.1.6l . In this context, we should 
note that the escape & pursuit interaction introduced in Sec. 16.3.11 represents a special case of 
general position and velocity-dependent attraction/repulsion interaction |288j . 

As stated in Sec. 16.3.11 the escape & pursuit interactions were directly motivated by the 
empirical evidence for cannibalism being the driving mechanism of collective motion in certain 
insect species (Mormon crickets, desert locusts) [319 24 25^. The simple Brownian agent model 
[289] can be easily modified to account in more detail for movement patterns of individual 
insects. A parametrization of such an extended escape & pursuit model with experimental 
results results not only in good agreement with the observations but enables us also to make 
specific predictions on the impact of the nutritional state of individuals on the onset of collective 
motion [5^ . A generalized version of the model |288] can account for different types of individual 
interactions ranging from pure avoidance behavior, via escape & pursuit to pure attraction and 
allows the evolution of escape and pursuit behavior and collective motion [146] . 

Finally, there are important biological question in the context of collective motion of higher 
organisms, which go far beyond the scope of this review (see e.g. [24711971329] ). For example, 
some recent publications investigate the impact of different information available to individuals 
[69168] , or the evolution of heterogeneous behavioral strategies within a group |145] . 

Outlook &i Final Remarks 

A major challenge for the future is the comparison of novel experimental results to predictions 
of the different theoretical models discussed here as well as their underlying assumptions. For 
example, the statistical properties of fiuctuations in the dynamics of active particles can be 
measured and analyzed in order to refine our description of active noise terms. Furthermore, 
the issue of variable speed and corresponding fluctuations needs certainly to be addressed in 
the future. Even if the general framework of Active Brownian particles accounts for variable 
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speed, there remain many open questions on important details. The corresponding theoretical 
results rely often on approximations and rather simple assumptions, which may not be justified. 
For example, possible non-trivial correlations between velocity fluctuations and changes in the 
direction may strongly influence the theoretical results. 

In collective dynamics it is import to distinguish between universal and system specific prop- 
erties. One would expect that minimal model systems should provide the answer. However, the 
unresolved connection between the giant number fluctuations and clustering in those systems 
reveals the conceptual difiiculties which have to be addressed in the future. From the more 
biological perspective, in the light of the new measurement discussed above, the question arises 
about new models which arc able to account for the observed interactions between individuals. 
Here, it appears that simple physically motivated pairwisc "forces" might be not sufficient, 
and that a more biological centered ansatz, based on the sensory and cognitive capabilities of 
individuals, can be very promising. 

In general, statistical physicists possess a large inventory of methods for describing and 
analysing complex systems, which is being continuously developed, on the background of a long 
experience in applying these methods to natural phenomena. In this spirit, the development of 
the mathematical description of natural active matter systems and their analysis, is essential for 
our understanding of the dynamical behavior of these systems, and gives us important insights 
into their role and function in the biological and ecological context. 

In conclusion, this review gives an overview over the theoretical foundations and concepts of 
active (Brownian) particles systems and discusses recent developments in the field of statistical 
physics applied to active particle systems far from equilibrium. We are aware that an all- 
encompassing review of the field is not feasible here, given the large number of publications 
from different disciplines and the intense ongoing research activity. Nevertheless, the focus on 
theoretical concepts and recent developments can be seen as complementary to other reviews 
on the topic (154l306l355j and we hope it will be of interest to researchers in statistical physics 
who would like to broaden their knowledge in this rapidly developing research field. 
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